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SECTION  1.0 
INTRODUCTION 


1.0  INTRODUCTION 


1.1  Overview 

Over  the  past  10-15  years  controls  researchers  have  come  to  the 
realization  that  classical  controls  analysis  and  design  techniques  are 
inadequate  in  the  face  of  modem  large  scale,  high-performarice  applications. 

In  particular,  the  principal  motivation  for  ORIS  is  the  problem  of  vibration 
suppression  in  large  lightweight  flexible  space  structures  characterized  by 
high-dimensional,  highly  uncertain  models.  In  addition,  stringent  performance 
specifications  in  the  face  of  high  disturbance  levels  place  severe  demands  on 
existing  control-design  techniques.  Specifically,  performance  tradeoffs 
involving  sensors,  processors,  actuators,  and  identification  accuracy  must  be 
cut  as  tightly  as  possible  to  minimize  hardware  and  testing  costs.  For 
feasibility  and  cost  effectiveness,  system  design  must  also  be  performed 
efficiently  with  respect  to  human  and  computer  resources. 

The  goal  of  this  project  has  been  to  develop  a  mathematically  rigorous 
control-design  methodology  which  directly  addresses  these  technology  issues. 

In  particular,  optimal  projection  theory  addresses  the  need  for  low-order, 
high-performance  controllers  which  can  be  implemented  on-board  for  real-time 
operation.  Lew-order  controllers  are  necessitated  by  cost,  weight,  and 
reliability  constraints  associated  with  space-qualified  processors. 

Furthermore,  ORJS  incorporates  a  fundamental  theory  of  robust  controller 
synthesis  to  account  for  unavoidable  modeling  uncertainties  arising  for  reasons 
such  as  material  and  manufacturing  variations,  thermal  and  aging  effects,  as 
well  as  limits  to  identification  accuracy.  The  principal  contribution  of  ORJS 
is  thus  a  unified  theory  which  simultaneously  accounts  for  both  real-time 
processor  constraints  and  modeling  uncertainty.  A  high  level  overview  of  ORJS 
is  given  in  [88]  (Appendix  A) . 

During  the  course  of  this  project  ORJS  has,  in  addition,  been  extended  to 
a  large  class  of  problems  in  systems  and  control  theory.  The  current  scope  of 
the  theory  includes  (see  Figure  1-1) : 


1.  A  unified  treatment  of  reduced-order  modeling,  estimation,  and 
control  (Appendix  B) ; 

2.  Robust  estimation  and  control  via  quadratic  Lyapunov  functions 
including  robust  performance  (Appendices  G,H,I); 

3.  A  unified  approach  to  and  ^  control  including  parametric 
robustness  (Appendix  J) ; 

4.  Decentralized,  nonstrictly  proper,  and  sanpled-data  control 
(Appendices  D,E,L) . 

Of  particular  interest  is  the  recent  extension  to  H*,  control.  As  shown  in 
[117]  (Appendix  J) ,  we  have  developed  a  method  for  directly  imbedding  design 
constraints  within  OPUS  theory  and  thus,  in  particular,  within  LQG.  These 
results  are  given  by  a  system  of  modified  Riccati  equations  which  directly 
generalize  LQG  theory  and  which  have  the  potential  for  significant 
computational  savings  compared  to  existing  H»  synthesis  methods. 

The  underlying  philosophy  of  OFUS  is  to  capture  as  many  design 
constraints  as  possible  within  a  single  system  of  design  equations.  This  is 
demonstrated  in  [117]  by  the  unification  of  time-  and  frequency-domain 
criteria  addressed  by  the  I^/I^o  design  equations.  An  additional  example  is 
provided  by  the  results  obtained  in  [119,94]  (Appendices  H  and  I)  for  robust 
stability  and  performance  via  fixed-order  compensation  in  the  presence  of  real¬ 
valued  structured  parameter  uncertainty.  In  these  algebraic  design  equations 
the  projection  matrix  automatically  enforces  a  constraint  on  controller  order, 
while  additional  terms  guarantee  both  robust  stability  and  performance.  Note 
that  for  full-order  controllers  in  the  absence  of  uncertainty,  these  four 
coupled  equations  reduce  to  the  standard  pair  of  separated  Riccati  equations  of 
LQG  theory.  Versions  of  these  equations  have  been  developed  for  each  of  the 
problems  shown  in  Figure  1-1.  These  results  are  discussed  in  more  technical 
detail  in  the  following  sections. 

The  justification  for  this  line  of  research  is  based  upon  several 
considerations.  First,  and  most  obvious,  is  the  fact  that  our  results  show 
that  numerous  design  constraints  can  be  captured  simultaneously  within  a 
constructive  theory  which  directly  generalizes  LQG  theory.  Such  an  approach 
provides  the  capability  for  simultaneously  performing  multiple  design  tradeoffs 


for  multivariable  systems  with  respect  to  competing  constraints  such  as  sensor 
noise,  control  authority,  controller  order,  robustness,  disturbance 
attenuation,  mean-square  error,  sample  rate,  degree  of  decentralization,  etc. 
Next  we  stress  that  rathe  than  being  ad  hoc  constructions,  these  design 
equations  follow  directly  from  the  optimality  of  well-defined  performance 
objectives.  Thus,  these  results  are  useful  in  assessing  the  suboptimality  of 
alternative  methods.  For  example,  as  shown  in  [20]  several  suboptimal 
approaches  to  reduced-order  control  design  can  be  viewed  as  approxima t ions  to 
the  optimal  projection  equations. 

1.2  Status  of  Computational  Results 

Overall,  OPUS  can  be  viewed  as  a  theory  for  characterizing  solutions  to 
constrained  control -design  problems.  Transforming  ORJS  into  a  practical  design 
methodology  requires  the  development  of  effective  computational  algorithms. 

Such  development  has  been  carried  out  in  related  work  by  S.  Richter  at  Harris 
Corporation.  Using  homotopic  continuation  methods,  Richter  has  developed 
efficient  algorithms  which  fully  account  for  the  structure  of  these  modified 
Riccati  equations  and  their  coupling  terms.  Homotopy  algorithms,  as  reviewed 
in 

S.  Richter  and  R.  DeCarlo,  "Continuation  Methods:  Theory  and 

Applications,"  IEEE  Trans.  Autom.  Contr. .  Vol.  28,  pp.  660-665, 

1983. 

offer  several  advantages  over  both  gradient-based  and  Newton-type  methods. 

For  example,  homotopy  methods  have  a  strong  theoretical  foundation  based  upon 
differential  topology,  in  particular,  topological  degree  theory,  while  in 
practice  these  methods  effectively  address  the  key  issues  of  startup, 
convergence,  and  global  optimality.  Homotopy  algorithms  have  also  reached  a 
high  degree  of  maturity  and  availability  with  the  advent  of  HOMPACK  described 


L.  T.  Watson,  S.  C.  Billups,  and  A.  P.  Morgan,  "A  Suite  of  Codes 
for  Globally  Convergent  Horootopy  Algorithms,"  ACM  Trans.  Math. 

Software.  Vol.  13,  pp.  281-310,  1987. 

Hie  continuation  algorithm  developed  for  the  optimal  projection  equations 
essentially  follows  a  smooth  path  connecting  an  easily  solvable  version  of  the 
equations  with  the  final,  desired  form.  The  algorithm  utilizes  the  tensor 
derivatives  of  the  terms  in  the  optimal  projection  equations  to  integrate  along 
the  solution  paths.  To  demonstrate  the  algorithm,  an  8th-order,  nonminimum 
phase  example  originally  due  to 

R.  H.  Cannon,  Jr.,  and  D.  E.  Rosenthal,  "Experiments  in  Control 
of  Flexible  Structures  with  Noncolocated  Sensors  and  Actuators," 

AIAA  J.  Guid.  Contr.  Dvn. .  Vol.  7,  pp.  546-553,  1984. 


was  considered.  This  problem  was  used  in 


Y.  Liu  and  B.  D.  O.  Anderson,  "Controller  Reduction  Via  Stable 
Factorization  and  Balancing,"  Int.  J.  Contr. .  Vol.  44,  pp.  507- 
531,  1986. 

to  compare  several  reduced-order  control-design  methods.  The  comparisons 
performed  by  Liu  and  Anderson  highlight  the  suboptimal  nature  of  these 
methods.  Specifically,  several  methods  failed  to  yield  stabilizing 
controllers  for  10%  of  the  cases  while  others  failed  for  as  many  as  60%.  In 
contrast,  as  reported  in  [68,102],  the  optimal  projection  approach  yielded 
stabilizing  controllers  for  all  cases  considered.  While  the  methods  compared 
by  Liu  and  Anderson  were  most  prone  to  failure  at  high  authority  levels,  the 
optimal  projection  results  were  within  20%  of  the  LQG  performance  at  102-103 
higher  authority  levels.  In  addition,  using  topological  degree  theory,  an 
upper  bound  has  been  obtained  on  the  number  of  solutions  of  the  design 
equations.  Letting  n  =  plant  dimension,  =  dimension  of  the  unstable  plant 
subspace,  =  compensator  order,  i  =  number  of  measurements,  and  m  =  number  of 
controls,  the  number  of  solutions  for  the  case  >  riy  is  not  greater  than 


1-5 


(minOhm.jO-rvA 

I,  r\.  <  min(n,m,jfc) , 

"c-nu  ) 

1  ,  otherwise. 

Hence,  for  the  case  in  which  the  controller  order  is  greater  than  the  number  of 
inputs  or  outputs  (so  that  the  controller  is  not  ill-conditioned) ,  the 
equations  possess  at  most  one  solution  corresponding  to  the  global  minimum. 
Furthermore,  since  in  many  practical  cases  of  interest  this  bound  is  small,  it 
suffices  to  compute  each  such  solution  to  determine  the  global  optimum.  These 
results  along  with  suitable  extensions  to  related  problems  have  been  used 
widely  throughout  this  project.  For  example,  recent  results  on  fixed-order 
control  of  distributed  parameter  systems  described  in  Section  2.3  were  obtained 
using  the  homotopy  algorithm. 

1.3  Long-Range  Goals  of  the  Project 

The  long-range  (5-10  year)  goal  of  this  project  is  the  development  of  a 
truly  effective  computer-aided  design  methodology  for  multivariable  control 
design.  Numerical  solution  of  the  design  equations  would  form  the  basis  for 
such  a  design  tool.  This  methodology  would  be  appropriate  in  an  engineering 
environment  since  the  user  need  not  be  familiar  with  the  mathematics  of  the 
design  equations  being  solved.  We  envision  a  methodology  similar  to  finite 
element  modeling  used  routinely  by  structural  analysts.  An  OPUS  design  package 
would  go  far  beyond  currently  available  packages  whose  multivariable  design 
capabilities  are  based  largely  upon  LQG  theory. 

1.4  Plan  of  This  Report 

Since  this  is  the  final  report  for  this  project  our  goal  is  to  accomplish 
the  following  objectives: 

1)  Review  the  evolution  and  maturation  of  the  research  plan  throughout 
the  project; 

2)  Highlight  the  principal  research  accomplishments;  and 
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3)  Summarize  open  problems  and  point  out  future  research  directions. 


Detailed  technical  discussion  of  results  obtained  will  not  appear  in  the  main 
body  of  the  report.  Rather,  the  appendices  contain  a  fairly  complete  (and 
lengthy)  collection  of  the  principal  research  results.  We  note  that  the 
ordering  of  the  appendices  is  not  chronological  but  instead  reflects  the  most 
logical  order  according  to  subject  matter. 
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SECTION  2.0 
FIXED-STRUCIURE  DESIGN 


2.0  FIXED-STRUCTURE  DESIGN 

2.1  Motivation 

While  achieving  the  system  design  specifications  (stability,  performance, 
etc.)  the  control-design  process  must  not  lose  sight  of  restrictions  which 
arise  in  controller  implementation .  Indeed,  control-design  methods  which 
focus  primarily  on  performance  specifications  often  pay  a  serious  price  by 
producing  controllers  which  are  difficult,  if  not  impossible,  to  implement  in 
practice.  Hence  our  approach  rests  upon  the  notion  of  f ixed-structure  design. 
That  is,  we  seek  to  meet  design  specifications  within  a  framework  which 
constrains  the  class  of  implementable  designs.  In  this  way  the  burden  of 
hardware  implementation  (sensors,  processors,  and  actuators)  can  be  minimized 
to  the  greatest  possible  extent. 

2.2  The  Three  Basic  Problems 

The  most  fundamental  restriction  arising  in  fixed-structure  design  is 
that  of  the  order,  or  dimension,  of  the  controller.  In  addressing  this 
problem  we  have  developed  a  unified  treatment  of  three  basic  problems  in 
reduced-order  design,  namely,  modeling,  estimation,  and  control.  These  three 
problems  form  a  fundamental  hierarchy  of  design  problems  in  system  theory, 
namely,  to  determine  a  system  of  fixed  degree  which,  for  a  given  system, 
approximates,  estimates,  or  controls  selected  plant  states.  The  solutions  to 
these  problems,  given  in  [32,29,24]  (Appendix  B) ,  reveal  a  surprising  degree  of 
common  structure.  Specifically,  the  solutions  involve  systems  of  2,  3,  and  4 
modified  algebraic  Riccati  and  Lyapunov  equations  coupled  by  a  projection 
matrix  (the  "optimal  projection") .  In  addition,  the  estimation  and  control 
results  provide  transparent  generalizations  of  steady-state  Kalman  filter  and 
IfiG  theory. 

Although  the  structure  of  these  equations  is  aesthetically  appealing  by 
itself,  the  principal  benefit  for  practical  purposes  is  conputational .  That 
is,  by  exploiting  the  structure  of  these  equations  it  is  possible  to 
significantly  reduce  the  computational  burden  inherent  in  commonly  used 
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gradient  search  techniques.  This  point  has  been  amply  demonstratr-’  in  [63,68] 
cis  discussed  in  Section  1. 

2.3  Finite-Dimensional  Control  of  Distributed  Parameter  Systems 

The  problem  of  controller  order  becomes  exacerbated  when  the  plant  is 
infinite  dimensional  since  infinite-dimensional  controllers  cannot  be 
implemented  precisely,  while  finite-dimensional  plant  approximations  may  be  of 
arbitrarily  high  order.  To  address  this  problem  the  fixed-structure  control- 
design  results  of  [24]  were  generalized  in  [37]  (Appendix  C)  to  the  case  in 
which  the  plant  is  infinite  dimensional.  The  resulting  design  equations  now 
comprise  a  system  of  four  operator  equations  coupled  by  a  finite-rank 
nonself  ad joint  projection  operator.  In  spite  of  the  infinite  dimensionality  of 
the  plant,  the  design  equations  directly  characterize  fixed-order,  finite¬ 
dimensional  dynamic  compensator  gains  (Figure  2-1) .  Corresponding  results  for 
fixed-order  finite-dimensional  modeling  and  fixed-order  finite-dimensional 
state  estimation  can  also  be  obtained  in  an  analogous  manner. 

Application  of  the  operator-theoretic  results  of  [37],  however,  requires 
finite-dimensional  approximation  of  the  design  equations.  In  practice  one 
could  solve  the  design  equations  for  a  sequence  of  plant  approximations  of 
increasingly  high  order  while  keeping  the  controller  order  fixed.  The  limiting 
controller  would  then  serve  as  a  nearly  optimal  fixed-order  finite-dimensional 
controller  for  the  original  distributed  parameter  system  (Figure  2-2) .  This 
was  investigated  numerically  in  [122]  in  a  collaborative  project  with  Professor 
I.  G.  Rosen.  In  [122]  two  alternative  approaches  were  considered  for  obtaining 
finite-dimensional  controllers  for  infinite-dimensional  systems.  The  first 
approach,  which  has  been  widely  studied,  involves  computing  a  sequence  of  full- 
order  LQG  controllers  for  a  sequence  of  high-order  plant  approximations,  while 
the  second  approach  assumes  a  fixed  order  for  the  dynamic  controller.  To 
demonstrate  these  methods,  two  examples  were  considered,  namely,  a  one¬ 
dimensional  parabolic  (heat/diffusion)  system  and  a  hereditary  (delay)  system. 
For  each  example  a  sequence  of  spline-based,  Ritz-Galerkin  finite  element 
approximations  was  derived  for  use  in  the  control -design  procedure.  LQG  theory 
and  the  optimal  projection  approach  were  then  used  to  obtain  full-  and  first- 
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Figure  2-1.  The  Optimal  Projection  Equations  For  Finite-Dimensional 
Fixed-Order  Dynamic  Compensation  of  Infinite-Dimensional  Systems 
Provide  a  Direct  Path  to  Optimal  Physically  Realizable  Controllers  for 

Distributed  Parameter  Systems 
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CONVERGENCE  OF  SUBOPTIMAL  REDUCED-ORDER  COMPENSATORS 


IDEA:  DESIGN  A  SEQUENCE  OF  REDUCED-ORDER  COMPENSATORS 
WHILE  INCREASING  THE  ORDER  OF  THE  APPROXIMATE  MODEL 
AND  KEEPING  THE  ORDER  OF  THE  COMPENSATOR  FIXED 

n*"  ORDER  DISTRIBUTED 


APPROXIMATE  MODEL  PARAMETER  SYSTEM 


n’eh-  ORDER  COMPENSATOR:  c  n*-  ORDER  COMPENSATOR: 

OPTIMAL  FOR  nlh  ORDER  OPTIMAL  FOR  DISTRIBUTED 

APPROXIMATE  MODEL  PARAMETER  SYSTEM 


Figure  2-2.  Numerical  Solution  of  the  Optimal  Projection  Equations  for 
Fixed-Order  Dynamic  Compensation  Provides  a  Path  to  the 
Optimal  Fixed-Order  Controller  for  an  Infinite-Dimensional  System 
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order  controllers  for  each  example  with  plant  approximations  up  to  32nd  order. 
For  the  parabolic  system  the  performance  degradation  of  the  first-order 
controllers  was  only  2%  compared  to  the  full-order  controllers  (Figure  2-3) , 
while  for  the  hereditary  system  the  degradation  was  less  than  10%.  The 
difference  in  implementation  requirements  for  a  first-order  versus  a  32nd-order 
controller  is,  of  course,  considerable. 

2.4  Decentralized  Control 

In  addition  to  incorporating  constraints  on  the  order  of  the  feedback 
compensator,  the  fixed-structure  approach  allows  additional  constraints  on  the 
complexity  of  the  feedback  law.  In  particular,  the  results  of  [24]  assumed  a 
centralized  structure  for  the  dynamic  compensator.  In  many  applications, 
however,  a  decentralized  controller  architecture  permits  a  simplified  feedback 
communication  structure  and  allows  increased  parallelism  in  the  control  law 
execution. 

The  f ixed-structure  approach  is  ideally  suited  to  the  decentralized 
design  problem.  For  each  fixed  decentralized  architecture,  the  design 
procedure  can  be  performed  to  assess  the  ability  to  meet  specifications  for  the 
given  configuration.  If  specifications  cannot  be  met,  then  the  feedback 
architecture  can  be  modified  to  improve  performance,  robustness,  etc. 

For  the  case  of  dynamic  compensation,  it  was  shown  in  [76]  that  the 
optimal  projection  technique  provides  a  direct  means  for  characterizing 
decentralized  controllers.  The  key  step  is  the  recil izat ion  that  each 
subcontroller  in  the  decentralized  configuration  must  be  an  optimal 
centralized  controller  when  viewed  as  a  controller  for  the  plant  and  remaining 
subcontrollers.  This  observation  immediately  suggests  a  sequential  design 
algorithm  in  which  individual  subcontrollers  are  alternately  refined  until 
convergence  is  achieved.  Because  the  method  is  based  upon  optimization 
principles,  performance  improvement  is  guaranteed  at  each  step.  This  technique 
was  demonstrated  numerically  in  [76]  (Appendix  D)  where  a  two-channel 
decentralized  controller,  fourth-order  in  each  channel,  was  designed  for  a  pair 
of  interconnected  simply  supported  beams.  The  algorithm  demonstrated 
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PLANT  APPROXIMATION  ORDER 


Figure  2-3.  The  LQG  Closed-Loop  Cost  via  Full-Order  Controllers 
is  Compared  to  First-Order  Optimal  Projection  Designs 
for  a  Parabolic  System 


convergence  to  a  decentralized  controller  whose  performance  was  within  10%  of 
the  fully  centralized  controller. 

For  the  case  in  which  each  subcontroller  is  a  static  (proportional) 
feedback  law,  it  is  possible  to  simultaneously  characterize  the  optimal  gains 
in  each  control  channel  without  requiring  a  sequential  approach.  A  thorough 
treatment  of  this  case,  including  robust  stability  and  performance,  is  given  in 
[121]  (Appendix  D) . 

2.5  Singular  Control 

An  important  generalization  of  the  results  of  [24]  involves  the  case  in 
which  the  controller  includes  a  static  feedthrough  component.  One  technical 
issue  which  arises  in  the  problem  formulation  is  that  the  I 2  norm  of  a  control 
signal  corrupted  by  white  noise  (as  a  result  of  measurement  feedthrough)  is 
infinite.  Hence  the  measurement  feedthrough  problem  is  only  well-posed  when 
either  the  measurement  noise  intensity  or  the  control  weighting  matrix  is 
singular.  As  is  well  known  from  the  singular  control  literature,  however, 
singular  problem  data  often  lead  to  complex  behavior  including  impulsive 
controls  and  singular  arcs.  The  imposition  of  a  smooth  controller  structure 
via  the  fixed-structure  approach  thus  precludes  such  complex  behavior. 

The  fixed-order  state  estimation  and  dynamic  compensation  results  of 
[29,24]  were  partially  extended  to  the  singular  case  in  [78,79].  Even  in  the 
full-order  case  the  singular  control  results  are  novel  since  standard  LQG 
theory  yields  only  strictly  proper  controllers.  The  results  of  [78,79]  were 
incomplete,  however,  since  the  gains  associated  with  certain  estimation  and 
feedback  paths  were  not  given  explicitly.  For  the  singular  estimation  problem 
this  defect  was  remedied  in 

Y.  Halevi,  "The  Optimal  Reduced-Order  Estimator  for  Systems  with 
Singular  Measurement  Noise,"  IEEE  Trans.  Autom.  Contr. .  Vol.  34, 

1989. 

where  all  feedback  gains  were  explicitly  characterized.  In  addition,  this 
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solution  was  shewn  to  agree  completely  with  results  obtained  using  standard 
limiting  methods.  For  the  corresponding  dynamic-cortpensation  problem  the 
complete  singular  solution  has  been  derived  in  joint  research  with  Professor  Y. 
Halevi  and  will  be  reported  in  [130,138,139]  (Appendix  E) . 
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SECTION  3.0 


ROBUST  ANALYSIS  AND  DESIGN 


3.0  ROBUST  ANALYSIS  AND  DESIGN 

3.1  Motivation 

The  purpose  of  feedback  control  is  to  achieve  desirable  performance  in  the 
face  of  uncertainty.  Although  identification  can  reduce  uncertainty  to  some 
extent,  it  is  often  impractical  and  residual  modeling  discrepancies  always 
remain.  For  example,  modeling  uncertainty  in  flexible  structures  may  arise  in 
the  mass,  damping,  and  stiffness  operators.  Controllers  must  therefore  be 
robust  to  achieve  desired  disturbance  rejection  in  the  presence  of  such 
modeling  uncertainty. 

3.2  Stochastic  Modeling 

Our  approach  to  robust  control  was  originally  inspired  by  stochastic 
parameter  modeling  within  a  linear-quadratic  optimization  framework.  In  a 
series  of  early  papers  [1-16],  D.  C.  Hyland  explored  the  ramifications  of  a 
multiplicative  white  noise  model  as  a  consequence  of  the  minimum  information 
modeling  technique  based  upon  the  Maximum  Entropy  Principle  of  Jaynes.  The 
intent  was  not  to  view  the  white  noise  process  as  a  literal  model  of  parameter 
uncertainty,  however,  but  rather  to  construct  a  tractable  design  model  which 
captures  the  effects  of  parameter  uncertainty  upon  system  performance. 

An  interesting  feature  of  the  Maximum  Entropy  modeling  approach  was  that 
the  multiplicative  white  noise  model  was  not  to  be  rigorously  interpreted  as  an 
I to  differential  model,  but  rather  in  terms  of  the  Stratonovich  formulation. 
Recasting  the  Stratonovich  model  in  terms  of  I to  differentials  then  led  to 
additional  "correction"  terms.  It  is  precisely  these  terms  which  were  shown  to 
play  a  crucial  role  in  capturing  the  effects  of  parameter  uncertainty.  Such 
effects  include  decorrelation .  i.e.,  the  decrease  in  cross-correlation  of 
system  states  due  to  parameter  uncertainty,  as  well  as  equilibration,  i.e.,  the 
tendency  of  state  variances  to  equalize  in  the  presence  of  high  levels  of 
uncertainty  thus  rendering  different  states  indistinguishable,  fhese  effects 
of  parameter  uncertainty  are  fundamental  features  of  high-order,  lightly  damped 
modal  systems.  An  interesting  treatment  of  these  ideas  for  structural  and 
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acoustic  analysis  can  be  found  in 

R.  H.  Lyon,  Statistical  Energy  Analysis  of  Dynamical  Systems: 

Theory  and  Application.  MIT  Press,  Cambridge,  MA,  1975. 

For  feedback  design  within  fixed-structure  design  theory,  the 
Stratonovich  model  produces  controllers  possessing  intuitively  appealing 
features.  Specifically,  such  control  laws  exhibit  high-authority  control  in 
the  low-frequency,  well-modeled  portion  of  the  structure  along  with  low- 
authority,  rate  dissipative  action  in  the  high-frequency  region  [35]  (Appendix 
F) .  The  ability  to  merge  and  unify  these  control  regimes  is  a  unique  and 
significant  contribution  of  the  Maximum  Entropy  approach. 

As  a  control-design  methodology,  however,  it  remained  to  validate  the 
approach  as  a  rigorous  robust  design  technique.  Optimal  controllers  designed 
in  the  presence  of  white  noise  disturbances,  it  was  reasoned,  cure 
automatically  desensitized  to  actual  deterministic  plant  parameter  variations. 
This  idea  was  confirmed  empirically  by  numerical  studies  in  [36,39]  which 
showed  an  efficient  design  tradeoff  between  performance  and  robustness  in  the 
presence  of  structured  real -valued  parameter  variations.  Further  robustness 
studies  confirming  these  results  were  carried  out  in 

A.  Gruzen,  "Robust  Reduced  Order  Control  of  Flexible 
Structures,"  C.  S.  Draper  laboratory  Report  #CSDL-T900,  April 
1986. 

A.  Gruzen  and  W.  E.  Vander  Velde,  "Robust  Reduced-Order  Control 
of  Flexible  Structures  Using  the  Optimal  Projection/Maximum 
Entropy  Design  Methodology,"  AIAA  Guid.  Nav.  Contr.  Conf . . 

Williamsburg,  VA,  August  1986. 

M.  Cheung  and  S.  Yurkovich,  "On  the  Robustness  of  MEOP  Design 
versus  Asymptotic  IQG  Synthesis,"  IEEE  Trans.  Autom.  Contr. .  Vol. 

33,  1988. 

In  spite  of  these  results,  it  was  clear  that  issues  concerning  stochastic 
modeling,  such  as  stochastic  stability  and  the  physical  interpretation  of  the 
model,  tended  to  obscure  the  effectiveness  of  the  technique  for  robust 
control.  Thus  a  crucial  step  in  the  evolution  of  our  approach  was  the  ability 
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to  shew  in  [77]  (Appendix  F)  that  such  controllers  are  guaranteed  to  be  robust 
for  all  cases  in  which  the  design  equations  are  solvable.  In  particular,  it 
was  shown  that  a  second-mcsnent  stochastic  stability  condition  in  the  presence 
of  a  time-exponential  cost  weighting  induces  a  Lyapunov  function  which 
guarantees  deterministic  robust  stability  over  a  prescribed  range  of  parameter 
variations.  This  result  thus  provided  the  bridge  to  cross  over  from  the  world 
of  stochastic  modeling  (a  statistical  theory)  to  deterministic  robustness 
theory  (a  theory  of  worst-case  bounds) . 

3.3  Robust  Analysis 

For  a  given  controller,  it  is  often  necessary  to  assess  the  stability  and 
worst-case  performance  of  the  closed-loop  system  as  parameters  vary  within  a 
specified  range  of  uncertainty.  This  is  a  problem  of  robust  analysis,  whose 
consideration  precedes  the  more  complex  problem  of  robust  controller  synthesis. 

Our  principal  mathematical  technique  in  robustness  analysis  is  Lyapunov 
stability  theory.  Here  the  idea  is  to  determine  a  Lyapunov  function  which 
guarantees  robust  stability  over  a  range  of  uncertain  parameters.  For  linear 
systems  we  employ  the  quadratic  Lyapunov  function 

V(x)  =  xTPx  (1) 

or,  equivalently,  the  Lyapunov  equation 

0  =  AtP  +  PA  +  R  (2) 

for  the  linear  system 


x  =  Ax  +  w. 


(3) 


The  dual  equation 


0  =  AQ  +  QAT  +  V 


(4) 
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is  also  useful  for  robust  performance  analysis  since  V  can  be  interpreted  as 
the  intensity  of  the  additive  white  noise  signed  w.  In  robust  analysis  one 
typically  replaces  (4)  by 

0  =  AQ  +  QAt  +  n  +  v,  (5) 

where  fi  is  an  additional  nonnegative-definite  matrix.  Now  robust  stability  of 
the  perturbed  system 

x  =  (A-4tCA)X  +  w  (6) 

is  assured  so  long  as 

AA Q  +  <  n.  (7) 

This  can  be  seen  by  rewriting  (5)  as 

0  =  (A+iiXA )Q  +  Q( A-tf*A)T  +  [fi- (AA£M&AT)  ]  +  V.  (8) 

Furthermore,  it  is  also  possible  to  guarantee  robust  performance  since  the 
solution  C^a  °f 

0  =  (A+dA)^  +  <^a(A-+AA)T  +  V  (9) 

satisfies 

<&A<  Q-  (10) 

The  above  technique,  developed  in  [115]  (Appendix  G) ,  provides  a  simple 
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approach  to  robust  stability  and  performance. 

To  develop  a  more  sophisticated  approach  one  can  replace  (5)  by 

0  =  AQ  +  QAT  +  n(Q)  +  V  (11) 

where  n(  • )  is  now  a  bounding  operator  which  satisfies 

AAQ  +  <&AT  <  fl(Q)  (12) 

for  all  variations  AA  in  a  specified  uncertainty  set  and  for  all  nonnegative- 
definite  matrices  Q.  This  approach  now  guarantees  the  bounding  a  priori  via 
(12)  and  the  problem  is  to  determine  whether  or  not  there  exists  a  solution  to 
(11). 

The  a  priori  bounding  technique  shewn  in  (11) ,  (12)  has  been  given  a 
fairly  complete  treatment  in  [123]  (Appendix  G) .  The  goal  in  [123]  was  to 
systematically  investigate  candidate  choices  for  the  function  h( •) .  This 
investigation  also  provides  a  unified  setting  for  particular  bounds  which  have 
been  used  in  various  control-design  contexts.  For  exanple,  for  A^^,  | cr^ |  <1, 
the  absolute  value  bound 

n(Q)  =  )AXQ  +  QA1T| ,  (13) 

where  | • |  replaces  each  eigenvalue  by  its  absolute  value,  was  proposed  in 

S.  S.  L.  Chang  and  T.  K.  C.  Peng,  "Adaptive  Guaranteed  Cost 
Control  of  Systems  with  Uncertain  Parameters",  1 EEE  Trans. 

Autom.  Contr. .  Vol.  AC-17,  pp.  474-483,  1972. 

On  the  other  hand,  writing  A^  =  DjEi#  the  bound 

n(Q)  =  D  +  QEQ,  (14) 
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where  D  =  and  E  =  E^E]_,  was  studied  in 


I.  R.  Petersen  and  C.  V.  Hollot,  "A  Riccati  Equation  Approach  to 
the  Stabilization  of  Uncertain  Systems",  Automatica.  Vol.  22, 
pp.  433-448,  1986. 


D.  Hinrichsen  and  A.  J.  Pritchard,  "Stability  Radius  for 
Structured  Perturbations  and  the  Algebraic  Riccati  Equation", 
Svs.  Contr.  Iett. .  Vol.  8,  pp.  105-113,  1986. 


Finally,  the  choice 


fl(Q)  =  aQ  +  q:_1a1qa1t 


(15) 


corresponds  to  the  bound  arising  from  a  multiplicative  white  noise  model  as 
discussed  in  [77]  and  Section  3.2.  We  call  (14)  the  quadratic  bound  (since  it 
is  quadratic  in  Q)  and  (15)  the  linear  bound  (since  it  is  linear  in  Q) . 

3.4  Robust  Synthesis 

The  principal  payoff  of  our  robust  stability  and  performance  technique  is 
the  ability  to  incorporate  these  bounds  directly  within  the  fixed  structure 
design  methodology.  This  can  be  done  by  bounding  the  cost  over  the  class  of 
parameter  uncertainties  prior  to  determining  the  feedback  gains.  The  resulting 
bound  is  then  treated  as  an  auxiliary  cost  which  can  then  be  minimized  by 
suitable  feedback  gains.  The  solution  to  this  optimization  problem  is  thus 
guaranteed  to  yield  robust  stability  and  performance. 

To  carry  out  this  procedure  it  is  essential  that  the  bound  Ci(  • )  be 
differentiable  with  respect  to  Q.  Furthermore,  n(*)  will  be  differentiable 
with  respect  to  the  feedback  gains  if  it  is  differentiable  with  respect  to  A^ 
(which  involves  gains  in  the  control -design  setting) .  These  requirements  thus 
suggest  the  linear  bound  (15)  and  the  quadratic  bound  (14)  as  the  prime 
candidates  for  robust  synthesis. 
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As  discussed  previously,  the  linear  bound  (15)  was  originally  suggested  by 
a  multiplicative  white  noise  model.  By  incorporating  this  bound  within  the 
design  procedure,  sufficient  conditions  for  robust  estimation  and  robust 
control  were  developed  in  [95,119]  (Appendix  H) .  In  addition,  a  unified 
treatment  of  robust,  reduced-order  modeling,  estimation,  and  control  was  given 
in  [89]  (Appendix  H) . 

The  quadratic  bound  (14)  has  also  been  developed  extensively  within  a 
design  context.  In  [101,83,94]  (Appendix  I)  the  problems  of  reduced-order 
modeling,  estimation,  and  control  were  considered  via  this  bound.  Finally, 
both  the  linear  and  quadratic  bounds  were  considered  simultaneously  in  [113] 
(Appendix  I) . 

3.5  Hv,  Theory 

The  robustness  theory  discussed  in  the  previous  subsections  addresses  the 
problem  of  real -valued  structured  parameter  uncertainty.  In  many 
applications,  however,  uncertainty  is  present  in  the  form  of  unstructured 
perturbations  to  the  plant  transfer  function.  A  typical  case  is  the  presence 
of  high-frequency ,  unmodeled  dynamics. 

A  mathematically  rigorous  approach  to  this  problem  involves  defining  a 
suitable  norm  on  the  space  of  plant  transfer  functions  to  characterize 
uncertainty  in  terms  of  neighborhoods  of  the  nominal  plant.  The  resulting 
theory  was  pioneered  by  Zames  in 

G.  Zames,  "Feedback  and  Optimal  Sensitivity:  Model  Reference 
Transformations,  Multiplicative  Seminorms,  and  Approximate 
Inverses,"  IEEE  Trans.  Autom.  Contr. .  Vol.  AC-26,  pp.  301-320, 

1981. 

while  recent  overviews  were  given  in 

B.  A.  Francis  and  J.  C.  Doyle,  "Linear  Control  Theory  with  an  1^, 
Optimality  Criterion,"  SIAM  J.  Contr.  Qptim. .  Vol.  25,  pp.  815- 
844,  1987. 
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B.  A.  Francis,  A  Course  in  Control  Theory.  Spr inger-Ver lag , 

New  York,  1987. 

The  most  fundamental  problem  of  ^  control  design  is  the  so-called 
Standard  Problem  considered  by  Francis:  determine  a  feedback  compensator 
which  minimizes  the  peak  (worst-case)  disturbance  attenuation  of  the  closed- 
loop  system.  By  introducing  suitable  weighting  matrices  and  problem 
transformations,  solutions  to  the  Standard  Problem  can  be  used  to  yield  robust 
controllers  for  unstructured  plant  uncertainty. 

Current  synthesis  methods,  however,  possess  two  principal  drawbacks: 
they  are  computationally  intensive  and  they  often  yield  excessively  high-order 
controllers.  These  difficulties  have  been  removed  with  the  advent  of  new  state 
space  solutions  to  the  Standard  Problem  given  in  [117]  (Appendix  J)  and 

I.  R.  Petersen,  "Disturbance  Attenuation  and  tf°  Optimization:  A 
Design  Method  Based  on  the  Algebraic  Riccati  equation, "  j»:r 
Trans.  Autom.  CDntr. .  Vol.  AC-32,  pp.  427-429,  1987. 

P.  P.  Khargonekar,  I.  R.  Petersen,  and  M.  A.  Rotea,  "rf°  optimal 
Control  with  State  Feedback,"  iKti)  Trans.  Autom.  Contr. .  Vol.  33, 
pp.  786-788,  1988. 

J.  C.  Doyle,  K.  Glover,  P.  P.  Khargonekar,  and  B.  A.  Francis, 
"State-Space  Solutions  to  Standard  H2  and  Control  Problems," 

Proc.  Aroer.  Contr.  Conf . .  pp.  1691-1696,  Atlanta,  GA,  June  1988. 

These  papers  characterize  solutions  to  the  Standard  Problem  in  terms  of 
modified  Riccati  equations.  The  computational  savings  of  this  approach  over 
earlier  methods  is  considerable,  possibly  two  orders  of  magnitude.  In 
addition,  the  dynamic  compensators  obtained  from  these  Riccati  equations  are  of 
the  same  order  as  the  plant  model.  This  approach  thus  removes  the  principal 
drawbacks  of  earlier  synthesis  methods. 

By  incorporating  the  fixed-structure  approach  we  have,  in  addition, 
obtained  the  most  general  solution  thus  far  available  for  the  Standard 
Problem.  Specifically,  in  [117]  (Appendix  J)  we  consider  the  minimization  of 
an  L2  performance  criterion  subject  to  a  constraint  on  the  closed-loop 
performance.  This  multi-norm  problem  formulation  thus  allows  the  designer  to 
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perform  tradeoffs  between  these  competing  performance  measures.  In  addition  we 
impose  a  constraint  on  the  order  of  the  dynamic  compensator  to  obtain  optimal 
low-order  feedback  controllers  which  satisfy  the  performance  constraint. 
Utilizing  an  eighth-order  nonminimum  phase  example  given  in 

R.  H.  Cannon,  Jr.,  and  D.  E.  Rosenthal,  "Experiments  in  Control 
of  Flexible  Structures  with  Noncolocated  Sensors  and  Actuators," 

AIAA  J.  Guid.  Contr.  Dvn. .  Vol.  7,  pp.  546-553,  1984. 

we  used  these  results  to  obtain  9  dB  improvement  over  the  corresponding  LQG 
design  (Figure  3-1) . 

Immediate  spinoffs  of  these  results  include  the  problems  of  model 
reduction  and  state  estimation.  The  model  reduction  problem  [114] 

(Appendix  J)  addresses  one  of  the  most  fundamental  problems  of  linear  system 
theory,  namely,  given  a  linear  time- invariant  system  of  degree  n,  find  a  linear 
time-invariant  transfer  function  of  degree  nm<n  which  minimizes  the  Ha  distance 
between  the  full-  and  reduced-order  systems.  Although  the  Hankel  norm  model- 
reduction  problem  has  been  widely  studied  as  in 

K.  Glover,  "All  Optimal  Hankel -Norm  Approximations  of  Linear 
Multivariable  Systems  and  Their  L°°-Error  Bounds,"  Int.  J. 

Contr. .  Vol.  39,  pp.  1115-1193,  1984. 

the  solution  to  the  H*,  problem  had  not  been  given  previousl /. 

For  state  estimation  the  Kalman  filter  provides  the  least  squares  (L2) 
optimal  solution.  In  certain  applications,  however,  it  may  be  desirable  to 
minimize  the  worst-case  frequency  content  of  the  error  signal.  This  problem  is 
addressed  in  [116]  (Appendix  J)  where  the  standard  steady-state  Kalman  filter 
is  generalized  to  include  a  bound  on  the  H»  norm  of  the  error  signal. 

Finally,  it  is  reasonable  to  expect  that  in  practice  both  structured  and 
unstructured  plant  uncertainty  will  be  present.  This  leads  to  consideration  of 
the  Standard  Problem  in  the  presence  of  parametric  uncertainty.  Thus  it  is  of 
interest  to  design  feedback  controllers  which  are  guaranteed  to  satisfy  a 
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Figure  3-1.  The  LQG/Hco  Design  Equations  Yield  9  dB  Improvement  Over  The 
Corresponding  LQG  Design  for  an  8th-Order  Nonminimum  Phase  Plant 
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specified  Ho  disturbance  attenuation  constraint  over  a  range  of  parametric 
uncertainty.  This  problem  has  been  addressed  in  [105]  (Appendix  J)  where  the 
results  of  [117]  on  Hx,  design  have  been  merged  with  these  of  [94,119]  on 
parametrically  robust  design.  Again  the  development  has  been  carried  out  in 
the  context  of  fixed-order  dynamic  compensation  for  maximal  design  flexibility. 
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SECTION  4.0 
FURTHER  EXTENSIONS 


4.0  FURTHER  EXTENSIONS 


4.1  Motivation 

The  previous  sections  have  addressed  two  principal  problems  in  control 
design,  namely,  fixed-structure  design  and  robustness.  Both  of  these  problems 
concern  fundamental  issues  in  the  practical  implementation  of  feedback 
controllers.  In  this  section  we  extend  these  results  in  two  directions  in 
order  to  address  larger  classes  of  design  problems. 

4.2  Tracking 

All  of  the  feedback  control  theory  discussed  in  Sections  2  and  3 
addresses  the  problem  of  feedback  control  for  regulation  in  the  presence  of 
external  disturbances.  Many  control  problems,  however,  are  of  a  tracking  or 
servomechanism  nature.  While  a  limited  class  of  such  problems  can  be  recast 
without  loss  of  generality  as  regulation  problems,  many  important  ones  cannot. 
For  example,  the  standard  transformations  given  in 

H.  Krfakemaak  and  R.  Si  van,  T  .inear  Optimal  Control  Systems. 

Wiley,  New  York,  1972. 

B.  A.  Francis,  A  Course  in  Control  Theory.  Springer-Verlag ,  New 

York,  1987. 

assume  that  the  command  signals  can  be  represented  as  an  augmentation  of  the 
plant  dynamics.  There  are  many  important  cases,  such  as  the  tracking  of  steps 
and  ramps,  which  must  be  represented  by  uncontrollable,  unstable  dynamics, 
where  this  transformation  cannot  be  applied.  Furthermore,  such 
transformations  often  ignore  controller  effort.  To  fill  this  gap  we  have 
undertaken  a  systematic  program  for  developing  a  tracking  control  theory 
consistent  with  earlier  developments.  As  a  first  step  we  have  considered  the 
problem  of  regulation  about  a  prescribed  nonzero  set  point,  which  corresponds 
to  the  step  command  tracking  problem.  Our  work  in  this  area  was  originally 
motivated  by  results  obtained  in 
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Z.  Artstein  and  A.  Leizarcwitz,  "Tracking  Periodic  Signals  with 
the  Overtaking  Criterion,"  IEEE  Trans.  Autom.  Contr. .  Vol.  AC-30, 
pp.  1123-1126,  1985. 

A.  Leizarcwitz ,  "Tracking  Nonperiodic  Trajectories  with  the 
Overtaking  Criterion,"  AppI.  Math.  Ootim. .  Vol.  14,  pp.  155- 
171,  1986. 

A.  Leizarowitz,  "Infinite  Horizon  Stochastic  Regulation  and 
Tracking  With  the  Overtaking  Criterion,"  Stochastics,  1987. 

References  [67,103]  (Appendix  K)  present  general  solutions  to  the  nonzero  set 
point  problem  for  both  static  and  dynamic  controllers.  The  overall  controller 
configurations  for  these  problems  are  shown  in  Figures  4-1  and  4-2.  Note  that 
these  controllers  involve  two  components,  namely,  a  closed-loop  feedback 
component  similar  to  a  regulator  and  an  open-loop  feedforward  component  which 
has  no  counterpart  in  the  standard  theory  and  which  cannot  be  obtained  from 
standard  transformations. 

Recent  activities  have  focused  on  extending  the  nonzero  set  point  results 
to  broader  classes  of  command  and  disturbance  signals.  It  turns  out  that  the 
challenging  case  (as  with  steps  and  ramps)  involves  signals  generated  by 
unstable  command  or  reference  dynamics.  As  a  critical  first  step  in  addressing 
this  problem  we  have  considered  the  problem  of  reduced-order  steady-state 
observer  design  for  unstable  plants.  These  results  appear  in  [125]  (Appendix 
K) .  This  optimal  subspace  observer  problem  gives  rise  to  yet  another 
projection  which  we  denote  by  jlu  The  most  general  estimation  problem  involving 
all  three  projections  r ,  v,  and  n  has  also  been  solved  and  will  be  reported  in 
[134,139] . 

4.3  Samoled-Data  Control 

The  discussion  in  the  previous  sections  has  focused  on  continuous-time 
systems  subject  to  continuous-time  (analog)  controllers.  In  practice,  however, 
controller  implementation  will  almost  invariably  utilize  digital  controllers 
within  the  context  of  sampled-data  control  systems.  Rigorous  consideration  of 
such  systems  is  critical,  particularly  for  distributed  parameter  systems  which 
possess  modal  frequencies  beyond  the  Nyquist  rate  of  anv  digital  controller. 


4-2 


CONSTANT 

DISTURBANCE 

Y 


Figure  4-1.  The  Static  Controller  for  Nonzero  Set  Point  Regulation 
Involves  Both  Feedforward  and  Feedback  Gains 
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Figure  4-2.  The  Dynamic  Controller  for  Nonzero  Set  Point  Regulation 
Involves  Both  an  Open-Loop  Gain  and  a  Closed-Loop  Dynamic  Compensator 
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Hence,  a  rigorous  theory  of  sampled-data  control  design  must  be  developed  which 
accounts  precisely  for  all  effects  arising  from  anal og-to-digital  and  digital - 
to-analog  operations. 

Optimal  projection  theory  for  discrete-time  systems  was  developed  in  [41] 
and  applied  to  sampled-data  systems  in  [44]  (Appendix  L) .  As  a  next  step  it  is 
desirable  to  obtain  robust  control  results.  To  this  end,  the  optimal 
projection  equations  for  reduced-order  discrete-time  estimation  and  control  in 
the  presence  of  multiplicative  white  noise  were  obtained  in  [54,69]  (Appendix 
L) .  After  these  results  were  obtained,  it  became  clear  that  a  true  sampled- 
data  robustness  theory  must  account  for  the  exponential  matrix  structure  which 
arises  from  the  sampling  process.  For  example,  if  A+aA  denotes  the  continuous¬ 
time  dynamics  matrix,  where  A  is  the  nominal  matrix  and  A  A  denotes  uncertainty, 
then  the  equivalent  discrete-time  dynamics  matrix  is  given  by  e(A'+AA)h,  where  h 
is  the  sample  interval.  Because  of  the  exponential  function,  however,  this 
discrete-time  dynamics  matrix  does  not  have  the  additive  structure  considered 
in  the  discrete-time  theory  in  [54,69].  Moreover,  a  linear  approximation  for 
the  exponential  will  not  be  valid  in  the  presence  of  system  time  constants  near 
or  above  the  sample  rate. 

Although  an  attempt  to  bound  this  discrepancy  resulted  in  new 
inequalities  in  [92]  and  questions  of  decomposition  in  [87]  (Appendix  L) ,  this 
approach  appears  inadequate.  The  crucial  clue  to  the  most  natural  approach  was 
ultimately  found  in 

A.  R.  Tiedemann  and  W.  L.  DeKoning,  "The  Equivalent  Discrete-Time 
Optimal  Control  Problem  for  Continuous-Time  Systems  with 
Stochastic  Parameters,"  Int.  J.  Cont. .  Vol.  40,  pp.  449-466, 

1984. 

which  studied  the  propagation  of  multiplicative  white  noise  in  the  presence  of 
A/D  and  D/A  interfaces.  Motivated  by  these  results,  we  have  obtained  results 
which  extend  the  robust  performance  bounds  obtained  for  continuous-time  systems 
to  the  sampled-data  problem.  Specifically,  by  considering  the  evolution  of  the 
linear  parameter  uncertainty  bound  over  the  sample  interval,  a  robust  stability 
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condition  was  developed  in  [128]  (Appendix  L) .  This  result  is  unique  in  that 
it  accounts  directly  for  the  exponential  structure  of  the  parameter 
uncertainty. 
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5.0  OPEN  FRDBIEMS 


5.1  Motivation 


Hie  value  and  importance  of  the  results  obtained  under  this  project  lie 
largely  in  the  foundation  they  provide  for  future  research.  The  purpose  of 
this  section  is  to  collect  together  various  questions  and  problems  as  a  guide 
to  future  endeavors.  The  order  of  listing  of  these  questions  roughly  parallels 
the  order  of  the  previous  sections. 


5.2  Fixed-Structure  Design 


Since  the  fixed-structure  design  approach  involves  a  nonconvex 
optimization  problem,  there  arise  several  questions  concerning  the  structure  of 
the  space  of  solutions. 


•  Do  there  exist  verifiable  a  priori  conditions  which 
guarantee  stabilizability  of  a  given  linear  time-invariant 
plant  by  fixed-order  dynamic  compensation?  As  in  the  full- 
order  case,  one  would  expect  such  conditions  to  play  a 
fundamental  role  in  determining  the  existence  of  solutions  to 
the  design  equations.  Conversely,  when  the  plant  is  known  to 
be  stabilizable  by  a  controller  of  order  r^,  does  the 
underlying  optimization  problem  always  possess  a  solution? 
Will  the  design  equations  always  yield  at  least  one  such 
stabilizing  controller?  How  is  the  ability  to  find 
stabilizing  controllers  affected  by  the  choice  of  weightings 
and  noise  intensities? 

•  Is  it  possible  to  design  all  subcontrollers  of  a 
decentralized  dynamic  compensator  simultaneously  without 
performing  sequential  iterations?  If  a  sequential  algorithm 
is  used,  then  under  what  conditions  is  the  algorithm 
guaranteed  to  find  the  global  minimum? 

•  How  can  the  fixed-structure  approach  be  extended  to  address 
the  simultaneous  stabilization  problem,  i.e.,  the  problem  of 
finding  a  single  controller  which  stabilizes  several 
different  plants  simultaneously? 

•  The  1>2  model  reduction  theory  of  [32]  (Appendix  B)  can 
readily  be  extended  to  the  problem  of  characterizing  optimal 
finite-dimensional  models  for  infinite-dimensional  systems 
using  the  method  of  [37]  (Appendix  C) .  Can  such  finite- 
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dimensioned  models  serve  as  useful  lumped  approximations  to 
distributed  parameter  systems?  Can  the  I^/Ho  model  reduction 
theory  of  [114]  (Appendix  J)  be  used  similarly? 

Hew  can  the  fixed-structure  approach  be  used  to  design 
controllers  with  additional  constraints  on  their  internal 
structure,  such  as  prespecified  pole  locations?  This 
question  is  the  basis  for  ongoing  work  in  [131]. 


5.3  Robust  Analysis  and  Design 


There  exist  a  variety  of  open  questions  concerning  the  conservatism  and 
effectiveness  of  the  parametric  robustness  bounds  and  the  Ho  design  equations. 

•  For  which  class  of  parameter  uncertainty  structures  are  the 
quadratic  Lyapunov  bounds  nonconservative?  Hew  can  the 
robustified  design  equations  be  used  iteratively  to  reduce 
design  conservatism? 

•  The  multiplicative  noise  model  was  shewn  in  [77]  (Appendix  F) 
to  guarantee  deterministic  robustness.  However,  this  result 
involved  a  uniform  right  shift  rather  than  the  variable  left 
shift  arising  from  the  Stratonovich  interpretation  of  the 
multiplicative  noise.  Can  it  be  shown  rigorously  that  the 
Stratonovich  model  yields  robust  controllers?  Furthermore, 
can  the  relationship  between  Stratonovich  design  and  positive 
real  controllers  for  modal  systems  be  made  precise? 

•  The  basis  for  the  Ho  design  results  obtained  in  [117] 

(Appendix  J)  is  the  quadratic  bound  developed  for 
parametrically  robust  control  in  [94]  (Appendix  I).  This 
raises  the  following  question:  Does  there  exist  an 
alternative  interpretation  of  the  linear  bound  which  can  be 
used  to  guarantee  disturbance  attenuation  for  some  specified 
class  of  disturbances? 

•  The  Ho  control  design  results  are  virtually  identical  to  the 
optimality  conditions  for  the  problem  of  minimizing  an 
exponential -of-quadratic  cost  criterion  as  considered  in 


P.  R.  Kumar  end  J.  H.  van  Schuppen,  "On  the  Optimal  Control  of 
Stochastic  Systems  With  an  Exponential -of -Integral  Performance 
Index,"  J.  Math.  Anal.  AppI..  Vol.  80,  pp.  312-332,  1981. 

P.  Whittle,  "Risk-Sensitive  Linear/Quadratic/Gaussian  Control," 
Adv.  AdqI.  Prob..  Vol.  13,  pp.  764-777,  1981. 
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A-  Bensoussan  and  J.  H.  van  Schuppen,  "Optimal  Control  of 
Partially  Observable  Stochastic  Systems  With  an  Exponential -of- 
Integral  Performance  Index,"  SIAM  J.  Contr.  Qptim. .  Vol.  23,  pp. 
599-613,  1985. 

P.  Whittle  and  J.  Kuhn,  "A  Hamiltonian  Formulation  of  Risk- 
Sensitive  Linear/Quadratic/Gaussian  Control,"  Int.  J.  Contr. 

Vol.  43,  pp.  1-12,  1986. 


Is  it  possible  to  directly  extend  these  results  using  the 
fixed  structure  approach?  Also,  can  the  fixed-structure 
approach  be  used  to  extend  the  Maximum  Entropy  theory  of 


D.  Mustafa  and  K.  Glover,  "Controllers  Which  Satisfy  a  Closed- 
Loop  Ho  Norm  Bound  and  Maximize  an  Entropy  Integral,"  Proc.  IEEE 
Conf .  Dec.  Contr. .  Austin,  TX,  December  1988. 


•  The  I^/Ha  model  reduction  theory  given  in  [114]  (Appendix  J) 
minimizes  an  Lq  criterion  subject  to  a  constraint  on  the  Ho 
distance  between  the  full-  and  reduced-order  models.  Can  the 
J-2  criterion  be  neutralized  so  as  to  obtain  a  "pure"  Ho 
result  as  is  done  in  [117]  (Appendix  J)  for  full-order 
control  design?  Can  the  resulting  Ho  solution  be  shown  to 
actually  characterize  the  Ho  optimal  reduced-order  model  by 
talcing  the  Ho  constraint  to  be  sufficiently  small?  Similar 
questions  apply  to  fixed-order  control  design.  For  example, 
does  there  exist  a  "pure"  Ho  reduced-order  control  design 
theory?  Can  these  results  be  shown  to  be  necessary  as  well 
as  sufficient? 

•  What  is  the  generalization  of  the  Ho  control  and  estimation 
results  to  the  singular  problem?  To  the  cross-weighting 
problem? 

•  Is  it  possible  to  extend  the  1%  and  Lg/Ho  model  reduction 
results  to  allow  the  reduced-order  model  to  be  nonstrictly 
proper? 


5.4  Trackincr  and  Sampled-Data  Control 


With  regard  to  tracking  and  sairpled-data  theory  a  number  of  problems 
remain  to  be  explored. 


Is  it  possible  to  develop  a  methodology  for  designing 
tracking  controllers  which  applies  to  a  broad  range  of 
signal  models?  For  example,  the  command  signal  may  be  known 
exactly  in  advance  (such  as  a  specified  square  wave)  while, 
at  the  other  extreme,  it  may  only  be  known  to  be  an  element 
of  a  large  class  of  signals.  For  example,  step  commands  are 
known  to  be  steps  but  their  exact  level  is  not  known  until 
they  actually  occur  during  operation.  Other  command  signals 
may  only  be  known  to  be  outputs  of  systems  driven  by  random 
noise.  A  classification  scheme  based  upon  the  degree  and 
type  of  priori  knowledge  of  the  command  signal  should  lead  to 
a  hierarchy  of  control  designs  ranging  from  poorly  known  to 
well-known  command  signals.  In  addition,  it  is  important  to 
distinguish  between  a  priori  command  signal  knowledge 
available  during  the  design  phase  and  command  signal 
knowledge  available  during  operation.  Ihe  differences 
between  these  cases  can  be  used  to  account  for  differing 
assumptions  appearing  in  the  literature.  Relevant  references 
include 


B.  D.  0.  Anderson  and  J.  B.  Moore,  Linear  Optimal  Control. 
Prentice-Hall,  Englewood  Cliffs,  NT,  1970. 

C.  D.  Johnson,  "Accommodation  of  External  Disturbances  in  Linear 
Regulator  and  Servomechanism  Problems,"  IEEE  Trans.  Autom. 
contr. .  Vol.  AC-16,  pp.  635-644,  1971. 

E.  J.  Davison  and  A.  Goldenberg,  "Robust  Control  of  a  General 
Servomechanism  Problem:  The  Servo  Compensator, "  Automat ica.  Vol. 
11,  pp.  461-471,  1975. 

E.  J.  Davison,  "The  Robust  Decentralized  Control  of  a  General 
Servomechanism  Problem, "  IEEE  Trans.  Autom.  Contr..  Vol.  AC-21, 
pp.  14-24,  1976. 

E.  J.  Davison,  "The  Robust  Control  of  a  Servomechanism  Problem 
for  Linear  Time-Invariant  Multivariable  Systems,"  IEEE  Trans. 
Autom.  Contr. ,  Vol.  AC-21,  pp.  25-34,  1976. 

E.  J.  Davison,  "Multivariable  Tuning  Regulators:  The 
Feedforward  and  Robust  Control  of  a  General  Servomechanism 
Problem,"  IEEE  Trans.  Autom.  Contr. .  Vol.  AC-21,  pp.  35-47, 

1976. 

C.  A.  Desoer  and  Y.  T.  Wang,  "Linear  Time-Invariant  Robust 
Servomechanism  Problem:  A  Self-Contained  Exposition,"  in 
Control  and  Dynamic  Systems.  Vol.  16,  C.  T.  Leondes,  Ed.,  pp.  81- 
129,  Academic  Press,  New  York,  1980. 
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E.  J.  Davison  and  I.  J.  Ferguson,  "The  Design  of  Controllers  for 
the  Multivariable  Robust  Servomechanism  Problem  Using  Parameter 
Optimization  Methods,"  IEEE  Trans.  Autom.  Contr. .  Vol.  AC-26,  pp. 
93-110,  1981. 

J.  D.  Turner,  H.  M.  Chun  and  J.-N.  Juang,  "Closed-Form  Solutions 
for  a  Class  of  Optimal  Quadratic  Tracking  Problems,"  J.  Ootim. 
TtlV.  APOl. ,  Vol.  47,  pp.  465-481,  1985. ^ 

J.-N.  Juang,  J.  D.  Turner  and  H.  M.  Chun,  "Closed-Form  Solutions 
for  Feedback  Control  with  Terminal  Constraints,"  AIAA  J.  Guid. 
Contr.  Dvn. .  Vol.  8,  pp.  39-43,  1985. 

W.  E.  Schmitendorf  and  B.  R.  Barmish,  "Robust  Asymptotic 
Tracking  for  Linear  Systems  with  Unknown  Parameters," 

Automat ica.  Vol.  22,  pp.  355-360,  1986. 


How  can  the  new  subspace  projection  n,  which  arises  in  the 
observer  design  problem  in  [125]  (Appendix  K) ,  be  used  to 
design  servoconpensators?  That  is,  can  n  be  used  to  design 
controllers  which  track  the  output  of  an  unstable  command 
model? 

Is  it  possible  to  develop  a  theory  of  robust  sampled-data 
controller  synthesis  which  accounts  directly  for  the 
exponential  structure  of  the  equivalent  discrete-time  model? 
The  results  of  [128]  (Appendix  L)  provide  a  starting  point  in 
this  regard. 

What  is  the  form  of  the  equations  for  the  Ha-constrained 
discrete-time  control-design  problem? 
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Abstract 


OPUS  (Optimal  Projection  for  Uncertain  Systems)  provides  new  machinery  for 
designing  active  controllers  for  suppressing  vibration  in  flexible  structures.  The 
purpose  of  this  paper  is  to  review  this  machinery  and  demonstrate  its  practical  value 
in  addressing  the  structural  control  problem. 


1.  Introduction 


For  many  years  it  has  been  widely  recognised  that  the  desire  to  orbit 
large,  lightweight  space  structures  possessing  high-performance  capabilities  would 
require  active  feedback  control  techniques.  More  generally,  the  need  for  such 
techniques  may  arise  due  to  the  combinations  of  either  1)  moderate  performance 
requirements  for  highly  flexible  structures  with  low-frequency  modes  or  2)  stringent 
performance  requirements  for  semi-rigid  structures  with  relatively  high-frequency 
modes  (Figure  1).  Applications  include  pointing,  slewing,  and  aperture  shape  control 
for  optical  and  RF  systems. 


"Small  structures 

■  Older  generation  ot  spacecraft 

■  Mosl  civil  engineering  structures 
(from  strength' static  loading 
point  ot  view) 


CONTROLLER  AUTHORITY  ANO  OR 
RESPONSE  RANGE  Of  INTEREST 


Large ”  structures 

■  Highly  flexible  spacecraft, 
tall  buildings  rapid  transit 
structures,  etc 

And/or 

•  Stringent  pointing  accuracy 
and  optical  quality 
requirements 

■  Noise  abatement  (acoustical/ 
structural  interaction) 


Figure  1.  The  Need  for  Active  Structural  Control  Arises  From 
Stringent  Performance  Requirements  or  Low-Frequency  Modes 
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DISTURBANCES 


Figure  2.  Vibration  Control  Systems  Utilize  Sensors,  Processors  and  Actuators 

to  Suppress  Disturbances 


The  problem  of  active  vibration  suppression  (Figure  2)  entails  the 
following  considerations: 

1#  Multiple,  highly  coupled  feedback  loops.  The  potentially  large  number  of 
sensor a  and  actuators  leads  to  a  fully  coupled  multi-input,  multi-output 
feedback  control  system. 

2.  Limited  actuator  power.  The  control  authority  available  from  on-board 
actuators  is  limited  by  weight,  size,  cost  and  power  considerations. 

3.  High-dimensional  models.  Large  structures  subjected  to  broadband 
disturbances  are  typically  represented  by  high-order  finite  element  models. 

A.  Limited  processor  capacity.  Reliability  and  cost  considerations  limit  the 
processor  capacity  available  for  on-board  real-time  implementation  of  the 
control  system. 

5.  Highly  uncertain  models  with  structured  uncertainty.  Finite  element  models 
often  exhibit  significant  error  particularly  as  modal  frequency  increases. 
Although  modal  testing  and  related  identification  methods  may  be  used  to 
improve  modeling  accuracy,  residual  uncertainty  always  remains  and 
unpredictable  on-orbit  changes  due  to  aging,  thermal  effects,  etc.,  must  be 
tolerated. 
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6.  Stringent  performance  requirements.  Since  active  space  structure  control 
is  most  relevant  in  precision  applications*  it  can  readily  be  expected  that 
performance  specifications  will  be  particularly  stringent. 

7,  Design  efficiency.  Because  of  implementation  complexity  due  to  the 
presence  of  multiple  loops,  high  dimension,  and  high  levels  of  uncertainty, 
the  control  design  approach  should  efficiently  utilize  both  synthesis  and 
analysis  techniques  (Figure  3). 


SYNTHESIS 


ANALYSIS 


Figure  3.  Control-System  Design  Must  Efficiently  Utilize  Both 
Synthesis  and  Analysis  Techniques 

These  considerations  pose  a  considerable  challenge  to  the  state-of-the-art 
in  control-design  methodologies.  For  example,  the  presence  of  multiple,  coupled 
feedback  paths  essentially  precludes  the  ef f ect iveness  of  single-loop  design 
techniques.  The  sheer  number  of  loops,  their  interaction,  and  the  need  to  address  a 
host  of  other  issues  render  such  methods  inefficient  and  unwieldy. 

In  addition  to  the  presence  of  multiple  loops,  the  high  dimensionality  of 
dynamic  models  places  a  severe  burden  on  control-design  methodologies.  For  example, 
although  LQG  (linear-quadrat ic-Gaussian)  design  is  applicable  to  multi-loop  problems, 
such  controllers  are  of  the  same  order  ae  the  structural  model  (Figures  A  and  5). 

Thus  LQG  and  similar  high-order  controllers  can  be  expected  to  piece  an  unacceptable 
computational  burden  on  the  real-time  processing  capability.  Hence  it  is  not 
surprising  that  a  variety  of  techniques  have  Keer.  pr  osed  to  reduce  the  order  of  LQG 
controllers,  A  comparison  of  several  such  methods  is  given  in  [1]. 

All  of  the  above  difficulties  are  severely  exacerbated  by  the  fact  that  the 
dynamic  (i.e.,  finite  element)  model  upon  which  the  control  design  is  predicated  may 
be  highly  inaccurate  in  spite  of  extensive  modal  identification.  Hence,  applicable 
control-design  methodologies  must  account  for  modeling  uncertainties  by  providing 
robust  (i.e.,  insensitive)  controllers.  Furthermore,  because  of  stringent 
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HIGH-ORDER  PLANT  x«Rn 


FULL-ORDER  CONTROLLER  xccRn 


STEADY-STATE  PERFORMANCE  CRITERION 

J(Ac,Bc.Cc)  =  lim  E[xTRnx  +  uTR2u] 

I— « 

Figure  4.  LQG  Theory  Addresses  the  Problem  of  Designing  a 
Quadrat ically  Optimal.  Full-Order  Dynamic  Compensator 

FULL-ORDER  CONTROLLER  GAINS 

Ac  =  A  -  QL-  IP 

B,  =  OCTV*1 
c  2 

C.  =  -R'1BTP 
c  Z 

SEPARATED  RICCATI  EQUATIONS 

0  =  AQ  ♦  QAt  +  Vi  -  QlQ  (Kalman  Filler) 

C  =  AtP  ♦  PA  ♦  Rj  -  PliP  (Regulator) 

ssbr-’b7  v  =  cTv-1c 

2  2 


Figure  5.  The  Optimal  Full-Order  (LQG)  Controller  Is  Determined  by 
Pair  of  Separated  Riccati  Equations 
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performance  requirements,  robust  control  design  must  avoid  conservatism  with  respect 
to  modeling  uncertainty  which  may  unnecessarily  degrade  performance.  A  salient 
example  of  conservatism  is  illustrated  in  Figure  6.  If  uncertainty  in  the  modal 
frequency  is  complexified  in  a  transfer  function  setting,  then  the  resulting  pole 
location  uncertainty  has  the  form  of  a  disk.  This  disk,  however,  intersects  the 
right  half  plane  in  violation  of  energy  dissipation.  Hence  one  source  of 
conservatism  is  the  inability  to  di f ferent iate  between  physically  distinct  parameters 
such  as  modal  frequency  and  modal  damping. 


Im  A 


'X" 

M  \ 


RIGHT-HALF-PLANE 
POLES  ARE  PHYSICALLY 
IMPOSSIBLE 


Re  X 


Figure  6.  Coir.plexification  of  Real  Parameters  May  Lead  to  Robustness  Conservatism 

Although  classical  methods  are  inappropriate  for  vibration  control,  a  wide 
variety  of  modern  techniques  are  available.  These  include  both  multi-loop  frequency- 
domain  methods  and  time-domain  techniques.  A  comprehensive  review  of  such  methods 
will  not  be  attempted  here.  Rather,  we  shall  merely  point  out  aspects  of  several 
methods  which  motivate  the  philosophy  of  OPUS  development. 

As  is  well  known,  dynamic  models  can  be  transformed  (at  least  in  theory) 
between  the  frequency  and  time  domains.  Significant  differences  arise,  however,  in 
attempting  to  represent  modeling  errors.  Specifically,  model-error  characterization 
of  a  particular  type,  which  is  natural  and  tractable  in  one  domain,  may  become 
extremely  cumbersome  when  transformed  into  the  other  domain.  For  example,  consider  a 
state  space  model  with  parameter  uncertainties  arising  in  the  system  matrices 
(A,B,C).  Upon  transforming  to  a  frequency  domain  model  G(s)  =  C(sl-A)  *B  the 
parametric  uncertainties  may  perturb  the  transfer  function  coefficients  in  a 
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complicated  manner.  A  more  natural  measure  of  uncertainty  for  transfer  functions  has 
been  developed  in  [2]  where  system  uncertainty  in  the  f requency  domain  is  modeled  by 
means  of  normed  neighborhoods  in  the  11-infinity  topology.  There  are  limitations  with 
this  approach,  however,  in  designing  controllers  for  vibration  suppression.  For 
example,  as  6hown  in  Figure  6,  complex! f ic at  ion  of  reel-parameter  uncertainties  such 
as  modal  frequencies  may  yield  unnecessary  conservatism,  while  norm  bounds  often  fail 
to  preserve  the  physical  structure  of  parameter  variations.  A  case  in  point  is  the 
lightly  damped  oscillator.  As  shown  in  [A42] ,  norm  bounds  predict  stability  over  a 
frequency  range  on  the  order  of  the  damping  while  in  fact  the  oscillator  is 
unconditionally  stable.  Furthermore,  with  regard  to  processor  throughput  tradeoffs, 
modem  frequency-domain  methods  typically  yield  high-order  controllers. 

Although  LQC  addresses  perf ormance/actuator  end  performance/ sensor 
tradeoffs  in  a  multi-loop  setting,  it  fails  to  incorporate  modeling  uncertainty. 

Thus  it  is  not  surprising,  as  shown  in  13],  that  LQG  designs  fail  to  possess 
guaranteed  gain  margin.  Since  LQG  designs  lack  6uch  margins,  attempts  have  been  made 
to  apply  frequency-domain  techniques  to  improve  their  characteristics.  One  such 
method,  known  as  LQG/LTR  ([4,5])  seeks  to  recover  the  gain  margin  of  full-state- 
feedbock  controllers.  Specifically,  full-ctate-feedback  LQR  controllers  are 
guaranteed  to  remain  stable  in  the  Face  of  perturbat  ions  of  the  input,  matrix  B  of  the 
form  crB  where  or  €  [  1/2, »).  As  shown  in  [6,7],  however,  the  full -state- feedback  gain 

margin  fails  to  provide  robustness  with  respect  to  perturbat ions  which  are  not  of 

T 

this  form.  For  instance,  the  example  given  in  [6]  with  B  =  [01]  can  be 

T 

destabilized  for  suitable  performance  weightings  with  perturbation  B(E)  =  [€  t]  for 
arbitrarily  small  £  in  spire  of  the  6  dB  margin.  Furthermore,  since  LQG/LTR  loop 
shaping  is  based  upon  singular  value  norm  bounds,  treatment  of  physically  meaningful 
real  parameter  variations  nay  lead  to  unnecessary  conservatism.  Several  approaches 
have  been  proposed  for  circumventing  these  difficulties  (see,  e.g.,  [8]). 

The  importance  of  addressing  the  problem  of  structured  uncertainty  in 
finite  element  models  cannot  be  overemphasized.  Structural  characteristics  such  as 
modal  frequencies,  damping  ratios,  and  mode  shapes  appear  explicitly  in  (A,B,C) 
state-space  models  as  physically  meaningful  parameters.  Uncertainty  in  mode  shapes, 
for  example,  which  appear  as  columns  of  the  B  matrix,  cannot  in  general  be  expected 
to  be  of  a  multiplicative  form  in  accordance  with  traditional  gain-margin 
specif icat ions.  This  is  precisely  the  problem  illustrated  by  the  example  of  [6] 
discussed  above.  Furthermore,  uncertainties  in  modal  frequencies  and  damping  ratios 
must  be  carefully  differentiated  since,  roughly  speaking,  modal  frequency 
uncertainties  affect  only  the  imaginary  part  of  the  pole  location  while  damping 
uncertainty  affects  the  real  part.  Although  these  and  related  observations 
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concerning  uncertainty  in  the  dynamic  characteristics  of  lightly  damped  etructures 
may  be  self  evident,  they  have  remained  largely  unexploited  in  standard  control- 
design  methods. 


2.  OPUS:  New  Machinery  for  Control-System  Design 

In  view  of  the  ability  of  LQG  theory  to  synthesize  dynamic  controllers  for 
multi-input,  multi-output  controllers,  it  is  not  surprising  that  LQG  forms  the  basis 
for  a  variety  of  structural  control  methods.  However,  as  discussed  previously,  LQG 
lacks  the  ability  to  address  performnnce/processor  and  performance/robustness 
tradeoffs.  This  situation  has  thus  motivated  the  development  of  numerous  variants  of 
LQG  which  entail  additional  procedures  which  attempt  to  remedy  these  defects.  OPUS, 
however,  is  distinctly  different.  Rather  than  append  additional  procedures  to  LQG 
design,  OPUS  extends  LQG  theory  itself  by  generalizing  the  basic  underlying 
machinery. 


As  shown  in  Figure  S,  the  basic  machinery  of  LQG  consists  of  a  pair  of 
separated  Riccati  equations  whose  solutions  serve  to  directly  and  explicitly 
synthesize  the  gains  of  an  optimal  dynamic  compensator.  The  contribution  of  OPUS  is 
to  directly  expand  this  machinery.  The  overall  approach  is  illustrated  in  Figure  7 
which  portrays  two  distinct  generalizations  of  the  basic  LQG  machinery.  As  Figure  7 
illustrates,  these  generalizations  can  be  developed  individually  when  either  lew- 
order  or  robust  controllers  are  desired.  The  appealing  aspect  of  OPUS,  however,  is 
the  ability  to  extend  LQC  to  address  both  problems  simultaneously  in  a  unified 
manner. 


Figure  7.  The  Standard  LQG  Result  Is  Generalized  by  Both  the  Fixed-Order 
Constraint  and  Modeling  of  Parameter  Uncertainties 


270 


In  the  following  sections  the  generalizations  depicted  in  Figure  7  will  be 
reviewed  following  the  left  branch.  Thar  is,  the  optimal  projection  approach  to 
reduced-order  controller  design  will  first  be  discussed  in  Section  3  wirhour 
introducing  plant  uncertainties.  In  Section  4  the  reduced-order  constraint  will  be 
retained  while  considering,  in  addition,  uncertainties  in  the  system  model.  In  esch 
case  the  discussion  will  focus  on  the  underlying  ideas  with  a  minimum  of  technical 
detail. 


Clearly,  in  order  for  a  novel  design  methodology  to  be  of  practical  value 
it  must  be  computationally  tractable.  Hence  Section  5  will  present  an  overview  of 
the  current  state  of  algorithm  development  for  solving  the  OPUS  design  equations. 
Finally,  Section  6  will  briefly  summarize  further  OPUS  generalizations  of  LQG  theory 
which  are  relevant  to  structural  control. 


3.  Extensions  of  LQG  to  Reduced-Order  Dynamic  Compensation 

The  simplecr,  most  direct  way  to  obtain  optimal  reduced-order  controllers 
is  to  redevelop  the  standard  LQG  result  in  the  presence  of  a  constraint  on  controller 
dimension  (Figure  8).  The  mathematical  technique  required  to  do  this  is  remarkably 
straightforward.  Specifically,  the  structure  and  order  of  the  controller  are  fixed 
and  the  performance  is  optimized  with  respect  to  the  controller  gains.  The  resulting 
necessary  conditions  obtained  using  Lagrange  multipliers  thus  characterize  the 
optimal  gains. 


HIGH-OROER  PLANT  x>Rn 


STEADY-STATE  PERFORMANCE  CRITERION 

J(Ae,Bc,Ce)  =  llm  E[xtR1*  +  utR2u] 

l—oo 

Figure  8.  In  Accordance  With  On-Board  Processor  Requirements,  a  Reduced-Order 
Constraint  Is  Imposed  on  the  Dimension  of  the  Dynamic  Compensator 
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This  parameter  optimization  approach  as  such  is  not  new  and  was 
investigated  extensively  in  the  1970's.  Typically,  however,  the  optimality 
conditions  were  found  to  be  complex  and  unwieldy  while  offering  little  insight  and 
requiring  gradient  search  methods  for  numerical  solution. 

One  curious  aspect  of  the  parameter  optimization  literature  is  that  no 
attempt  was  made  to  actually  use  this  direct  method  to  rederive  the  LQC  result 
itself.  Such  an  exercise,  it  may  be  surmised,  might  reveal  hidden  structure  within 
the  optimality  conditions  which  would  shed  light  on  the  reduced-order  case.  Indeed, 
such  an  approach  led  to  the  realization  that  an  oblique  projection  (idempotent 
matrix)  is  the  key  to  unlocking  the  unwieldy  optimality  conditions  ([A7.A17]). 
Although  the  result  is  mathemat ! tally  straightforward,  it  is  by  no  means  obvious 
since  in  the  full-order  (LQG)  case  the  projection  is  the  identity  and  hence  not 
readily  apparent. 

By  exploiting  the  presence  of  the  projection,  the  necessary  conditions  can 
be  transformed  into  a  coupled  system  of  four  algebraic  matrix  equations  consisting  of 
a  pair  of  modified  Riccati  equations  and  a  pair  of  modified  Lyapunov  equations 
(Figure  9).  The  coupling  is  via  the  oblique  projection  r  which  appears  in  all  four 
equations  and  which  is  determined  by  the  solutions  Q  and  P  of  the  modified  Lyapunov 
equations.  A  satisfying  feature  of  the  optimality  conditions  is  that  in  the  full- 
order  case  the  projection  becomes  the  identity,  the  modified  Lyapunov  equations  drop 
out.  and.  since  =  0,  the  modified  Riccati  equations  specialize  to  the  usual 
separated  Riccati  equations  of  LQG  theory.  Since,  furthermore,  C  =  T  =  nxn  identify, 
the  standard  LQG  gain  expressions  are  recovered. 

Although  the  modified  Riccati  equations  specialize  to  the  standard  Riccati 
equations  in  the  full-order  case,  the  modified  Lyapunov  equations  have  no  counterpart 
in  the  standard  theory.  The  role  of  these  equations  can  be  understood  by  considering 
the  problem  of  optimal  model  reduction  alone.  For  this  problem  the  optimal  reduced- 
order  model  is  characterized  by  a  pair  of  coupled  modified  Lyapunov  equations 
(see  [A22] ) .  Thus  the  modified  Lyapunov  equations  arising  in  the  reduced-order 
dynamic-compensation  problem  are  directly  analogous  to  the  modified  Lyapunov 
equations  arising  in  model  reduction  alone.  The  modified  Lyapunov  equations  arising 
in  the  control  problem,  hovqyer,  are  intimately  coupled  with  the  modified  Riccati 
equations.  Hence  it  cannot  be  expected  that  reduced-order  control -design  techniques 
based  upon  LQG  will  generally  yield  optimal  fixed-order  controllers  (Figure  10).  It 
is  interesting  to  note  that  several  such  methods  discussed  in  [1]  are  based  upon 
balancing  which  vas  shown  in  [A22]  to  be  suboptimal  with  respect  to  the  quadratic 
(least  squares)  optimality  criterion. 


REDUCED-ORDER  CONTROLLER  GAINS 


ac  =  i(a-qI-i:p)Gt 
bc  =  rocTyj’ 
ce  =  -B"’BtPGt 


COUPLED  RICC ATI/LYAPUNOV  EQUATIONS 

0  =  AQ  ♦  QAT  ♦  V,  -  q£0  + 

0  =  ATP  ♦  PA  ♦  R,  -  PLP  ♦  r^PXPr, 

0  =  (A-SP)6  ♦  G(A-i.P)T  +  QlQ  -  TjOSq rT, 

0  =  (A-QS)tP  ♦  P(A-Qi)  +  PIP  -  jTPiPr, 

rank  0  =  rank  P  =  rank  OP  =  ne 
3p  =  GtMI'  I'Gt  =  lnc 

r  =  GTr  *  OP{QP)»  t,  =  ln  -  t 

s  =  brj'bt  £  =  cTVj'c 


Figure  9.  The  Optimal  Reduced-Order  Compensator  In  Determined  by  a 
Pair  of  Modified  Riccati  Equations  and  a  Pair  of  Modified  Lyapunov  Equations 
Coupled  by  the  Oblique  Projection T 


Figure  10.  The  Optimal  Projection  Equations  Provide  a  Direct  Path  to 
Optimal  Reduced-Order  Dynamic  Compensators 
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In  summary,  the  opt  Inal  projection  equations  for  reduced-order  dynamic 
compensation  coaprise  a  direct  extension  of  the  basic  LQC  machinery  to  the  reduced- 
order  control  problem.  The  design  equations,  which  reduce  to  the  standard  LQC  resulr 
in  the  full-order  case,  provide  direct  synthesis  of  optimal  reduced-order  controllers 
in  accordance  with  implementation  constraints. 


A.  Extensions  of  LQC  to  Uncertain  Modeling 

Two  fundamental  sources  of  error  in  modeling  flexible  structures  are 
truncated  modes  and  parameter  uncertainties.  Since  the  optimal  projection  approach 
permits  the  utilisation  of  the  full  dynamics  model,  modal  truncation  can  be  largely 
avoided.  There  remains,  however,  a  tendency  ro  truncate  poorly  known  modes  and  thus 
it  is  essential  to  incorporate  a  model  of  parameter  uncertainty  in  both  well-known 
and  poorly  known  components  of  the  system.  Hence  the  problem  formulation  of  Figure  8 
is  now  generalized  in  Figure  11  to  include  uncertain  parameters  tr.  appearing  in  the 
A,  B  and  C  matrices.  The  parameter  <r.  is  assumed  to  lie  within  the  interval  [-Sj.S;] 
in  accordance  with  identification  accuracy.  Clearly,  when  uncertainty  is  absent, 
i.e.,  when  A^,  B.,  C.  =  0,  the  reduced-order  design  problem  of  Figure  8  is  recovered. 

HIGH-ORDER,  UNCERTAIN  PLANT 

■  Stochastic  disturbance  model 

■  Deterministic  parameter  uncertainty  model 


kll 


LOW-ORDER  CONTROLLER 

■  Dynamic  (strictly  proper) 

■  Static  (constant  gain) 

■  Dynamic/static  (nonstrlctly  proper) 

Figure  11.  Robust  Optimal  Projection  Design  Is  Based  Upon  a 
Hybrid  Uncertainty  Model  Involving  a  Deterministic  Parameter  Uncertainty  Model 
and  a  Stochastic  Disturbance  Model 
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A  salient  feature  of  the  design  model  is  that  uncertainty  is  modeled  in  two 
distinctly  different  ways.  External  uncertainty  appearing  as  additive  white  noise  is 
modeled  stochastically.  Such  a  model  appears  appropriate  for  disturbances  such  as 
coolant  flow  for  which  only  power  spectral  data  are  available.  On  the  other  hand. 
internal  uncertainty  appearing  as  parameter  variations  is  modeled  deterministically. 
Such  a  model  appears  appropriate  for  uncertainty  arising  from  directly  measurable 
quantities  such  as  mass  and  stiffness.  Thus  the  overall  uncertainty  model  is  hybr i d 
in  the  sense  that  it  utilizes  both  deterministic  and  stochastic  characterizations  of 
uncertainty. 

A  natural  performance  measure  which  accounts  for  both  types  of  uncertainty 
characterization  involves  the  usual  LQG  quadratic  criterion  averaged  over  the 
disturbance  statistics  and  then  maximi zed  over  the  uncertain  parameters  (Figure  12). 
Hence  this  performance  measure  incorporates  on  the  average  and  worst  case  aspects  in 
accordance  with  physical  considerations. 


PERFORMANCE  CRITERION 
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ROBUST  PERFORMANCE  PROBLEM 

Minimize  J(Ac,Bc,Cc)  over  the  class  o(  robustly 
stabilizing  controllers  (Ac,Bc,Cc) 


Figure  12.  Performance  Is  Defined  To  Be  Worst  Case  Over  the  Uncertain  Parameters 
and  Average  Over  the  Disturbance  Statistics 


The  resulting  Robust  Performance  Problem  thus  involves  determining  the 

gains  (A  ,B  ,C  )  to  minimize  the  performance  J.  The  static  gain  D  can  also  be 
C  C  C  C 

included  but  will  not  be  discussed  here.  Despite  the  apparent  complexity  of  the 
problem,  remarkably  simple  techniques  can  be  used.  Specifically,  first  note  that 
after  taking  the  expected  value  the  performance  J  has  the  form 

J(A  ,B  ,C  )  =  sup  lim  sup  tr  Q(t)R, 
e  c  c  0"i  t— >- 


(4.1) 
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where  "tr"  denotes  trace  of  a  matrix,  Q(t)  is  the  covariance  of  the  closed-loop 
system,  and  R  is  an  augmented  weighting  matrix  composed  of  R^,  R, 2  and  .  The 
covariance  Q(t)  satisfies  the  standard  Lyapunov  differential  equation 


Q  =  (A+£°-A.)Q  ♦  Q(A+£ojA.)T  +  V,  (A. 2) 

where  A  is  the  closed-loop  dynamics,  A.  is  composed  of  A.,  B.  and  C.,  and  V  is  the 
intensity  of  external  disturbances  for  the  closed-loop  system  including  the  plant  and 
measurement  noise. 

TWo  distinct  approaches  to  this  problem  will  be  considered.  The  first 
involves  bounding  the  performance  over  the  class  of  parameter  uncertainties  and  then 
choosing  the  gains  to  minimize  the  bound.  Since  bounding  precedes  control  design 
this  approach  is  known  as  robust  design  via  a  priori  performance  bounds.  The  second 
approach  involves  exploiting  the  nondestabilizing  nature  of  structural  systems  via 
weak  subsystem  interaction. 

A.l  Robust  Design  Via  A  Priori  Performance  Bounds 

The  key  step  in  bounding  the  performance  (A.l)  is  to  replace  (A.2)  by  a 
modified  Lyapunov  differential  equation  of  the  form 

g  =  Ag  +  *  *(g)  +  v.  (4.3) 

where  the  bound  'fr  satisfies  the  inequality 

S°J(A.2+SaJ)  <  +(£)  (A. 4) 

over  the  range  of  uncertain  parameters  cr.  and  for  all  candidate  feedback  gains.  Note 
that  the  inequality  (A. 4)  is  defined  in  the  sense  of  nonnegative-definite  matrices. 
Now  rewrite  (4.3)  by  appropriate  addition  and  subtraction  as 


2  =  (a+I>.a.)2  +  2<A+£<r.A.)T+  +(g)  -  +  v-  .  (4.5) 


Now  subtract  (4.2)  from  (4.5)  to  obtain 


2  "  Q  *  (A+2>.A. )  (2-2)  +  (2-Q)  (A+£cr.A.)T  +  *(£)  - 


(4.6) 
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Since  by  (4.4)  the  term 

*<2>  -  (4.7) 

is  nonnegative  definite,  it  follows  immediately  that 

<3  £  2  (4.8) 

over  the  class  of  uncertain  parameters.  Thus  the  performance  (4.1)  can  be  bounded  by 
J (A  ,B  ,C  )  <  J (A  ,B  .C  )  -  lim  tr  2R.  (A. 9) 

CCC--CCC  t_>m 

The  auxiliary  cost  J  is  thus  guaranteed  to  bound  the  actual  cost  J.  This  leads  to 
the  Auxiliary  Minimization  Problem:  Minimize  the  auxiliary  cost  J  over  the 
controller  gains.  The  advantage  of  this  approach  is  that  necessary  conditions  for 
the  Auxiliary  Minimization  Problem  effectively  serve  as  sufficient  conditions  for 
robust  performance  in  the  original  problem.  Since  the  bounding  step  precedes  the 
optimization  procedure,  this  approach  is  referred  to  a6  robust  design  via  a  priori 
performance  bounds.  This  procedure  is  philosophically  similar  to  guaranteed  cost 
control  ([9,10]).  Note  rhat  since  bounding  precedes  optimization,  the  bound  (A. A) 
must  hold  for  all  gains  since  the  optimal  gains  are  yet  to  be  determined. 

To  obtain  sufficient  conditions  for  robust  stability,  the  bounding  function 
♦  must  be  specified.  Since  the  ordering  of  nonnegat ive-def inite  matrices  appearing 
in  (A. A)  is  not  a  total  ordering,  a  unique  lowest  bound  should  not  be  expected. 
Furthermore,  each  differentiable  bound  leads  to  a  fundamental  extension  of  the 
optimal  projection  equations  and  thus  of  the  basic  LQG  machinery.  In  work  thus  far, 
two  bounds  have  been  extensively  investigated.  Only  one  bound,  the  right 
shift/multiplicative  white  noise  bound,  will  be  discussed  here.  The  structured 
stability  radius  bound  introduced  in  [11,12]  is  discussed  in  [AA3]. 

The  right  shift/multiplicative  white  noice  bound  investigated  in  [A29.AA1] 
is  given  by 

+  (2>  =  E«j(“iS+<lrjlA.2AT-J.  (4.10) 

where  >  0  are  arbitrary  scalars.  Note  that  rhis  bound  consists  of  two  distinct 
parts  which  must  appear  in  an  appropriate  ratio.  The  first  term  a. 2  arises  naturally 

V 

when  an  exponential  time  weighting  e  is  included  in  the  performance  measure.  As 
is  well  known  ([13])  this  leads  to  a  prescribed  uniform  stability  margin  for  the 
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closed-loop  system  (Figure  13).  A  uniform  srsbility  margin,  no  matter  how  large, 

however,  does  not  guarantee  robustness  with  respect  to  arbitrary  parameter 

-1*  ~~T 

variations.  The  complementary  second  term  a.  A.gAj  is  crucial  in  this  regard. 


x  =  Ax  x  =  (A  +  al)x,  a  >  0 

lm 


APPLY  CONTROL-DESIGN  TECHNIQUES 
TO  RIGHT-SHIFTED  OPEN-LOOP  SYSTEM 
O  UNIFORM  STABILITY  MARGIN 
(Anderson  and  Moore,  1969) 


Figure  13.  Open-Loop  Right-Shifted  Dynamics  Arising  From  Exponential  Cost  Weighting 
Lead  to  a  Uniform  Closed-Loop  Stability  Margin 


Although  terms  of  the  form  A,QA.  are  unfamiliar  in  robust  control  design, 

they  arise  naturally  in  stochastic  differential  equations  with  multiplicative  white 

noise*  That  is,  if  the  uncertain  parameters  <r.  are  rep  1  seed  by  white  noise  processes 

entering  multipl icar ively  rather  than  addifively,  then  the  covariance  equerion  for 

- 

automatically  includes  terms  of  the  form  A.QA. .  The  literature  on  systems  with 
multiplicative  white  noise  16  quite  extensive;  see  [A38]  for  references.  It  should 
be  stressed,  however,  that  for  our  purposes  the  multiplicative  white  noise  model  is 
not  interpreted  literally  as  having  physical  significance.  Rather,  multiplicative 
white  noise  can  be  thought  of  os  a  useful  design  model  which  correcrlv  captures  the 
impact  of  uncertainty  on  the  performance  functional  via  the  state  covariance. 
Furthermore,  just  ae  the  right  shift  term  alone  does  not  guarantee  robustness, 
neither  does  the  multiplicative  white  noise  term.  Both  terms  must  appear 
simultaneously.  Roughly  speaking,  since  multiplicative  white  noise  disturbs  the 
plant  though  uncertain  parameters,  the  closed-loop  system  is  automat ical ly 
desensitized  to  actual  parameter  variations. 


o  l 
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After  incorporating  the  right  chi f f/mulr ipl icar ive  white  noiee  bound  (A. 10) 
info  (A. 3)  to  obtain  a  bound  J  for  the  performance,  the  optimal  projection  equations 
can  be  rederived  following  exactly  the  same  parameter  optimization  procedure 
discussed  in  Section  3.  Again,  the  mathematics  required  i6  bur  a  straightforward 
application  of  Lagrange  multipliers.  The  additional  bounding  terms  are  carried 
through  the  derivation  to  yield  a  direct  generalization  of  the  optimal  projection 
equations  shown  in  Figure  IA  with  gains  given  in  Figure  15. 
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Figure  1A.  The  Robustified  Optimal  Projection  Design  Equations  Account  for  Both 
Reduced-Order  Dynamic  Compensation  and  Parametric  Uncertainty 


GAINS 

Ac  =  r(As-BsR2Vro,v2;  Cj)Gt 
Bc  =  «v,v^ 

Cc  =  -«*2>SgT 

NOTATION 

QP=GTMr,  rGT  =  l„  (■=>  r  =  GTr=r2) 

p  p 

AO\T  =  i)  AiQaT,  aQP  =  lAiQB.,  etc. 
i=1  1  1=1 

R2g  *  R2  +  8T(P+P)s  v2s  =  V2  +  C(Q*OKT 

0$  ,  QC  J  +  v12  +  A(Q+Q)CT  r$  =  BTp  +  R^2  +  BT(PeP)A 

Figure  15*  The  OPUS  Controller  Cains  Are  Explicitly  Characterized  as  a 
Direct  Generalization  of  the  Classical  LQG  Gains 
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The  robust i f ied  optimal  projection  equations  comprise  a  system  of  four 
matrix  equations  coupled  by  both  the  optimal  projection  and  uncertainty  terms.  When 
the  uncertainty  terms  are  absent,  the  optimal  projection  equations  of  Figure  9  are 
immediately  recovered.  On  the  other  hand,  if  the  order  of  the  controller  is  set 
equal  to  the  order  of  the  plant,  then  all  terms  involving  con  be  deleted. 

However,  in  this  case  the  modified  Lyapunov  equations  do  not  drop  out  since  Q  and  P 
still  appear  in  the  modified  Riccari  equations.  Hence  the  basic  machinery  of  LQC  is 
again  extended  to  include  a  pair  of  Lyapunov  equations  coupled  to  a  generalization  of 
the  standard  LQG  equations.  It  is  interesting  to  note  that  a  related  result  in  the 
context  of  multiplicative  noise  also  appeared  in  the  Soviet  literature  ([lA]).  It 
should  also  be  pointed  out  that  although  the  modified  Lyapunov  equations  arising  in 
the  reduced-order  control-design  problem  hove  analogues  in  model  reduction,  the 
modifi.'v  Lyapunov  equations  appearing  in  the  full-order  robust ified  equations 
represent  new  machinery  not  anticipated  in  robustness  theories.  Hence  using 
straight  forward  raarhemat ical  techniques,  the  basic  LQG  machinery  has  again  been 
extended  in  novel  directions. 

Solving  the  design  equations  shown  in  Figures  l  A  and  15  yields  controllers 
with  guaranteed  levels  of  robustness.  The  actual  robustness  levels  may,  however,  be 
larger  than  specified  by  a  Priori  bounds.  Thus,  to  achi«*ve  desired  robust  if  icat  ion 
levels  for  the  uncertainty  structure  specified  by  the  a  priori  bounds,  the  design 
procedure  may  be  utilized  within  an  iterative  synthesis/analysis  procedure 
(Figure  16). 


SYNTHESIS 


Figure  16.  Optimal  Project ion/Guaranreed  Cost  Control  Provides 
Direct  Synthesis  of  Robust  Dynamic  Compensators 

A. 7  Robust  Design  Via  Weak  Subsystem  Interaction 

The  mechanism  by  which  LQC  was  robust  if ied  in  Section  A.l  nvolved  bounding 
the  performance  over  the  class  of  oaratneter  uncertainties  and  then  determining 
optimal  controller  gains  for  the  performance  bound.  As  discussed  in  Section  2. 
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however,  flexible  structures  possess  special  properties  which  may,  in  addition,  be 
exploited  to  achieve  robustness.  Specifically,  aside  from  rigid-body  modes,  energy 
dissipation  implies  that  mechanical  structures  are  open-loop  stable  regardless  of  the 
level  of  uncertainty.  That  is,  flexible  structures  possess  only  nondesr abil  tzinp, 
uncertaint ies.  Hence,  in  the  closed  loop,  a  given  controller  may  or  may  not  render  a 
particular  uncertainty  destabi 1 i zing.  A  priori  bounds  on  controller  performance 
must,  however,  be  valid  for  all  gains  since  bounding  precedes  optimization.  Hence,  a 
priori  bounding  may  in  certain  coses  fail  to  exploit  nondestab il izing  uncertaint ies. 

A  familiar  example  of  a  nondestabilizing  uncertainty  involves  uncertain 
modal  frequencies.  Such  an  uncertainty  will  not,  of  course,  destabilize  an 
uncontrolled  (open-loop)  structure.  If  particular  modal  frequencies  are  poorly  known 
''hen  it  is  clearly  advisable  to  avoid  applying  high  authority  control.  Hence,  rather 
than  the  right-shift  approach  of  Figure  13,  it  appears  advantageous  (although,  at 
first,  counterintuitive)  to  utilize  just  the  opposite,  namely,  a  left  shift 
(Figure  17).  Furthermore,  in  view  of  the  fact  that  uncertainty  usually  increases 
with  modal  frequency  (Figure  18),  a  variable  left  shift  appears  to  be  more 
appropriate  than  a  uniform  left  shift.  By  left-shifting  high-frequency  poorly  known 
modes,  the  control -system  design  procedure  applies  correspondingly  reduced  authority 
to  modes  "perceived"  as  highly  damped.  Hence  the  variable  left  shift  can  be  roughly 
thought  of  86  a  device  for  achieving  suitable  authority  rolloff.  As  will  be  seen, 
however,  the  underlying  robust i ficat ion  mechanism,  namely,  weak  subsystem  interaction, 
is  far  more  subtle  than  the  approach  of  classical  rolloff  techniques.  It  is  also 
interesting  to  note  that  the  weak  subsystem  interaction  approach  to  robustness  is 
entirely  distinct  from  classical  robustness  approaches  which  utilize  high  loop  gain 
to  reduce  sensitivity. 


x  =  Ax  -►  x  =  (A  + 


Im 


LARGE  OPEN-LOOP  SHIFT 
IN  HIGH-FREQUENCY  REGION 
O  LOW  CLOSED-LOOP  AUTHORITY 


SMALL  OPEN-LOOP  SHIFT 
IN  LOW-FREQUENCY  REGION 
O  HIGH  CLOSED-LOOP  AUTHORITY 

-Re 


figure  17.  K  Variable  Left  Shift  Exploits  Open-Loop  Nondestebilizing  Uncertainties 
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MODAL  FREQUENCY 

- ► 


COHERENT  MOOES 
(Strosg  Correlation) 


- —  v - 

INCOHERENT  MODES 
(W«ak  Contlation) 


High-Authority  Control 


Low-Authority  Control 


Figure  18.  Modal  Uncertainty  Generally  Increases  With  Frequency 

A  variable  left  shift  can  readily  be  introduced  into  the  robustified 
optimal  projection  design  equations  by  replacing  A  by 


as  =  a  +  £>;. 


(4.11) 


where  A  denotes  the  structure  of  modal  frequency  uncertainty  (Figure  19).  Most 

j 

interestingly,  such  a  modification  of  the  dynamics  matrix  arises  narurally  from  a 
multiplicative  white  noise  model  defined  not  in  the  usual  Ito  sense  but  rather  in  rhe 
senae  of  Stratonovich.  Thus,  as  in  the  a  priori  bounding  approach,  a  stochastic 
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Figure  19.  For  Modal  Systems  With  Frequency  Uncertainty 
the  Stratonovich  Correction  Corresponds  to  a  Variable  Left  Shift 
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model  serves  to  suggest  a  mechanism  for  robustif icot ion  (Figure  20).  Again  it  is 
important  to  stress  that  the  multiplicative  white  noise  model  is  not  interpreted 
literally  as  having  physical  significance,  but  rather  can  be  thought  of  as  a  useful 
design  model  which  correctly  captures  the  impact  of  uncertainty  on  the  performance 
functional  via  the  state  covariance. 


ROBUSTNESS  BOUNDS 


QUADRATIC  LYAPUNOV  FUNCTION 


ITO  NOISE  MOOEL 


MAJORANT  LYAPUNOV  FUNCTION 


▼ 

STRATONOVICH  NOISE  MOOEL 


STOCHASTIC  UNCERTAINTY  MODELS 


Figure  20.  Stochastic  Models  and  Robustness  Bounds  Are  Fundamentally  Related 


In  earlier  work  the  Stratonovich  dynamics  model  was  justified  by  means  of 
the  minimum  in  format ion/max imum  entropy  approach  ( [A1-A15] ) .  A  central  result  of  the 
maximum  entropy  approach  is  that  the  high  aurhori ty/low  authority  transition  of  a 
vibration  control  system  from  well-known  low-frequency  modes  to  poorly  known  high- 
frequency  modes  (Figure  18)  is  directly  reflected  in  the  structure  of  the  stare 
covariance  matrix  (Figure  21).  A  full-stare  feedback  design  applied  to  a  simply 
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Figure  21.  Frequency  Uncertainties  in  the  Stratonovich  Model  Lead  to 
Suppressed  Cross  Correlation  in  the  Steady-State  Covariance 
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supported  beam  illustrates  this  point  (Figure  22).  By  assuming  that  uncertainty  in 
modal  frequencies  increases  linearly  with  frequency,  the  structure  of  the  covariance 
matrix  leads  directly  to  the  control  gains  illustrated  in  Figure  23.  Note  that  in 
the  high-frequency  region  rhe  position  gains  are  essentially  zero  and  thus  the 
control  law  approaches  positive-real  energy  dissipative  rate  feedback.  This,  of 
course,  is  precisely  the  type  of  structural  controller  expected  in  the  presence  of 
poor  modeling  inforraat ion.  Of  course,  any  effective  cont rol-design  theory  for  active 
vibration  suppression  in  flexible  structures  should  produce  energy  dissipative 
controllers  when  structural  modeling  information  is  highly  uncertain. 


•  SIMttY  SUPPORTED  BUM  WITH  FORCE  ACTUATOR 

•  rail  STATE  FEFOftACX 


•  NONDIMENSIONAl  EQUATIONS 
OF  MOTION  =  »*) 

•  tMBCr  STATf-WICHTINC 

•  UNCERTAINTIES  IN  0PFN100P 
FREQUENCIES 

tk*  V  1‘VV1 

nM  s  STANDARD  DEVUTION 
OF  Kill  MOOI  FREQUENCY 

•  SIMPlf  UNCERTAINTY  MOOEt 

n%  s  °,JH 


Figure  22.  The  Effects  of  Frequency  Uncertainties  Con  Be  Illustrated 
for  a  One-Dimenoional  Beam  With  Idealized  Full-State  Feedback 


To  carry  out  robust i fled  optimal  projection  design  in  the  presence  of  left- 
shifted  open-loop  dynamics,  it  is  only  necessary  to  utilize  the  left-shifted  dynamics 
matrix  (A. 11)  in  place  of  the  right-shifted  matrix.  All  of  the  robustified  optimal 
projection  machinery,  including  gain  expressions,  con  be  utilized  directly.  It  is 
also  important  to  stress  that  the  left  shift  must  be  used  in  conjunction  with  terms 

-  — t 

of  the  form  A.QA . . 

i  i 

One  explanation  for  the  mechanism  by  which  robust ificat ion  is  achieved  is 
illustrated  in  Figure  2A.  By  left  shifting  the  open-loop  dynamics  within  the  design 
process,  the  compensator  poles  are  similarly  left-shifted.  Thus  the  compensator 
poles  are  effectively  moved  further  into  the  lefr  half  plane  sway  from  the  actual 
plant  poles.  Since  the  interaction  between  compensator  and  plant  poles  is  weakened, 
the  closed-loop  system  is  correspondingly  robustified  with  respect  to  uncertainties 
in  the  plant  pole  locations.  A  sensitivity  analysis  of  this  mechanism  utilizing  a 
uniform  left  shift  in  the  context  of  LQG  design  is  given  in  [15J . 
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A  ONE  STEP  OIRfCT  RESULT  OF  STRATONOVICH  MODEL 

Figure  23,  The  Maximum  Entropy  Controller  Approaches  Rate  Feedback  i 
Limit  of  Poor  Modeling  Information  (High  Uncertainty) 
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Figure  2A,  The  Stratonovich  Variable  Left-Shift  Model  Effectively  Places  the 
Compensator  Poles  Further  Into  the  Left  Half  Plane  Where 
Plant/Compensator  Interaction  Is  Weakened 
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As  discussed  above,  the  left-shift  approach  exploits  open-loop 
nondestabilizing  uncertainties  and  thus  cannot  operate  through  a  priori  bounding. 

Thus  the  actual  level  of  robust ificat ion  achieved  from  the  robustified  optimal 
projection  equations  for  a  given  level  of  uncertainty  modeling  cannot  be  predicted  a 
priori,  i.e.,  in  advance  of  control  design.  Indeed,  this  situation  is  to  be  expected 
when  nondestabilizing  uncerta int ies  are  exploited  in  a  nonconservative  design  theory. 
Thus  a  suitable  robust  analysis  technique  is  required  for  nonconservac ively 
determining  the  robust  if icat ion  of  the  closed-loop  system  with  respect  to  open-loop 
nondestabilizing  uncertainties. 

A  suitable  robustness  analysis  technique,  known  as  majorant  Lyapunov 
analysis,  has  indeed  been  developed  ( [AA2] ) .  Essentially,  this  technique  employs  a 
new  type  of  Lyapunov  function  for  assessing  robustness  due  to  weak  subsystem 
interaction.  The  underlying  machinery  consists  of  the  block-norm  matrix  which  is  a 
nonnegat ive  matrix  each  of  whose  elements  is  the  norm  of  a  block  of  a  suitably 
partitioned  marrix  (Figure  25).  A  matrix  which  bounds  the  block-norm  matrix  in  the 
sense  of  nonnegarive  matrices,  i.e.,  element  by  element,  ia  known  as  a  majorant. 
Majoranta  were  introduced  in  (16)  and  were  applied  to  stability  analysis  of 
integration  algorithms  for  0DE*6  in  [17], 

(Ostrowski,  1961;  Dahlquist,  1983) 
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Figure  25.  The  Matrix  Majorant  Is  a  Bound  for  the  Matrix  Block  Norm, 
i.e.,  the  Nonnegative  Matrix  Each  of  Whose  Elements  Is  the  Norm  of  the 
Corresponding  Block  of  a  Given  Matrix 
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To  apply  majorants  to  dynamical  systems,  the  model  is  written  in  the  form 
shown  in  Figure  26.  The  matrix  A  is  block  diagonal  and  consists  of  subsystem 
dynamics.  The  subsystem  interactions  represented  by  the  partitioned  matrix  G  are 
assumed  to  be  uncertain.  By  suitable  manipulation,  uncertainties  in  the  diagonal 
blocks  ot  A  can  also  be  captured  by  G.  By  assuming  that  the  spectral  norm  (largest 
singular  value)  of  the  blocks  of  G  satisfy  given  bounds,  the  covariance  block-norm 
inequality  is  obtained  (Figure  27).  This  inequality  is  interpreted  in  the  sense  of 
nonnegative  matrices,  i.e.,  element-by-element,  and  *  denotes  the  Hadamard  (element- 
by-element)  product. 
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Figure  26.  The  Large-Scale  System  Model  Involves  Known  Local  Dynamica 
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Figure  27.  The  Block-Norm  Matrix  of  the  State  Covariance  Satisfies 
Lyapunov-Type  Inequality  Involving  Nonnegative  Matrices 
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To  achieve  robustnesa,  the  covariance  block-norm  inequality  ia  replaced  by 
the  aajoranr  Lyapunov  equation  (Figure  28).  The  aolution  of  the  majorant  Lyapunov 
equation  providea  a  bound  (majoranr)  for  the  block  norm  of  the  covariance  thereby 
guatanteeing  both  robuet  etability  and  performance. 

MAJORANT  LYAPUNOV  EQUATION 

/2*Q  =  SQ  +  QST  +  ? 

?(G|j)  ^  Sij 

£ 

Q  <  <  Q 

4 

■  Robust  Stability 

■  Robust  Performance 

Figure  28.  The  Corresponding  Nonnegative  Matrix  Equation  Yields  a  Majorant 
for  the  State  Covariance  and  lienee  Robust  Stability  and  Performance 

It  is  interesting  to  note  that  numerical  solution  of  the  oajorant  Lyapunov 
equation  requires  no  new  techniques.  Utilizing  properties  of  M  matrices,  the 
solution  can  be  obtained  monotonically  by  means  of  a  straightforward  iterative 
technique  (Figure  29). 

MLE  has  a  unique  solution  id  ((Ok.  K=0,  1, ....  *|  where: 

Qo  -  0 

Qk+i  -  'l1'1  *  (’/  Qk  *  (0k<‘  /T  +  V) 

converges.  II  so,  then: 

/\  /\ 

Q  -  Mm  (Ok 

K-=c 

r  „  y\ 

J  -  Jo  <  2%  (tr  Pk)(cjQ)kk 

K=1 

(0  =  A  PK  ♦  pkAK  +  RK> 

Figure  29.  By  Exploiting  the  Properties  of  M-Matrices, 
the  Majorant  Lyapunov  Equation  Can  Be  Solved  Monotonically  by  Meana  of  a 
Simple  Iterative  Technique 
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An  illustrative  application  of  the  majorant  Lyapunov  equation  involves 
lightly  damped  subsystems  (Figure  30).  As  shown  in  [AA2]  (and  expected  intuitively), 
robustness  with  respect  to  uncertain  subsystem  interaction  is  proportional  to  the 
frequency  separation  between  the  subsystems.  The  ability  to  capture  this 
robustif icat ion  mechanism  is  a  unique  feature  of  the  majorant  Lyapunov  function  not 
available  from  quadratic  (i.e.»  scalar)  Lyapunov  functions  or  vector  Lyapunov 
functions  ([18.19)). 


Majorant  Lyapunov  Equation  Bound  ~  v  ,  (2v>)2  +  (u>i-u  2>2 


Figur.  30.  Robustness  Bounds  for  Uncertain  Coupling  in  Hodal  Systems 
Are  Proportions!  to  the  Frequency  Separation  Between  Subsystems 


The  next  step  in  the  majorant  development  involves  a  hierarchy  of  finer  and 
finer  robustness  bounds  which  account  for  higher  order  subsystem  interactions,  e.g., 
the  interaction  between  the  ith  and  jth  subsystems  via  the  kth  subsystem.  The  second 
member  of  the  hierarchy  (Figure  31)  provides  robustness  guarantees  with  respect  to 
frequency  uncertainties.  The  interesting  aspect  of  this  robustness  test  is  the  fact 
that  the  performance  bound  is  characterized  precisely  by  a  Stratonovich  model.  Hence 
the  Stratonovich  model  can  be  viewed  as  an  approximation  to  a  robustness  bound,  while 
exploiting  the  Stratonovich/majorant  relationship  leads  to  a  natural 
synthesis/ analysis  scheme  (Figure  32)  which  nonconservst ively  exploits  open-loop 
nondestabilizing  uncertainties. 
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SYNTHESIS 


ANALYSIS 


Slratonovich  synthesis  =  approximation  to  majorant  analysis 

Figure  31.  The  Stratonovich  Synthesis  Model  Provides  a  First  Approxination  to  the 

Majorant  Analysis  Bounds 


Second  member  of  the  hierarchy: 

>1*0  +  HiQ]  =  y,<Q>  *  <Q>(jT  +  V 

r 

J  -  tr[QR]  <  2±  (tr  PK)(Li<Q>)kK 
K=1 


0  =  AQ  ♦  OAt  +  J/[Q]  +  V 
0  =  AtP  +  PA  +  //HP]  +  R 
where:  ^  /\ 

<Q>  =  otf-diagonal  part  of  Q 
III.]  =  Slratonovich  model  operator 

■  Tighter  bound — Incorporates  more  information  on  A  and  G 

•  Predicts  stability  when  (A  +  A^)  stable,  G  =  -G^ 

•  “Nominal”  performance,  tr  [6r],  given  by  Stratonovich  model 

Figure  32.  The  Refined  Majorant  Bound  Incorporates  a  Stratonovich  Covariance  Model 
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5.  numerical  Algorithms  and  Examples 

Practical  design  of  controllers  is  only  possible  when  efficient,  reliable 
algorithms  are  available.  Indeed,  the  optimal  projection  equations  are  readily 
solvable  and  have  been  applied  to  a  wide  variety  of  examples.  Numerical  results 
appear  in  (A3-A6,A8,A11,A12, A14-A16.A18, A19, A21-A24, A26-A28, A30-A33, A39, A42. A44,  A46] . 
Two  distinctly  different  algorithms  have  been  developed  thus  far.  namely,  an 
iterative  method  and  a  homotopy  alnoritlan. 

The  iterative  method,  developed  in  [A14.A16.A44]  and  further  studied  in 
[20,21],  is  outlined  in  Figure  33.  The  nice  feature  of  this  approach  is  that  only 
a  standard  LQC  software  package  is  required  for  its  implementation.  The  basic 
motivation  for  the  method  is  the  observation  that  the  main  source  of  coupling  is 
via  the  terms  involving  r^.  The  coupling  is  absent,  of  course,  when  r  is  the 
identity,  i.e.,  LQG,  Note  also  that  the  terms  involving  are  small  when  and 
V2  are  large,  i.e.,  when  control  cost  is  high  and  the  measurement  noise  is 
significant.  This  case,  which  yields  low-authority  controllers,  is  approximately 
characterized  by  decoupled  control-design  and  controller-reduction  operations. 

Thus  it  is  not  surprising  that  LQG  reduction  techniques  are  most  successful  when 
controller  authority  is  low. 

Since  the  terms  occasion  the  greatest  difficulty,  it  appears 
advantageous  to  bring  them  into  play  gradually.  This  can  be  accomplished  by  fixing 
r  after  each  iteration  to  yield  updated  values  of  Q,  P,  Q  and  P.  Furthermore,  r  is 
introduced  gradually  by  means  of  a  to  reduce  its  rank. 

The  crucial  step  of  the  algorithm  concerns  the  construction  of  the 
projection  T  from  the  pseudogramians  Q  and  P.  Specifically,  r  can  be  characterized 
(see  [A22])  as  the  sum  of  eigenproject ions  of  QP,  where  each  choice  of 
eigenprojections  may  correspond  to  a  local  extremal.  However,  the  necessary 
conditions  do  not  specify  which  eigenprojections  are  to  be  selected  for  obtaining  a 
particular  local  solution.  Nevertheless,  there  do  exi6t  useful  methods  for 
constructing  r.  For  example,  component-cost  decomposition  methods  ([22])  when 
applied  within  the  optimal  projection  framework  often  permit  efficient  identification 
of  the  global  optimum. 

Although  the  iterative  method  is  convenient  to  use  because  it  utilizes 
readily  available  software,  it  is  suboptimal  in  the  sense  that  it  does  nor  fully 
exploit  the  structure  of  the  equations.  Specifically,  while  the  iterative  method 
addresses  a  system  of  four  nxn  matrix  equations,  careful  analysis  reveals  that 
because  of  the  rank  deficiency  of  the  projection  the  problem  can  be  recast  as  four 
n  xn  equations.  Hence,  when  n^  is  much  smaller  than  n,  which  is  clearly  the  most 


COMPUTE  0.  P.  0.  P  >0 


Figure  33.  The  Iterative  Method  for  Solving  the  Robuatified  OPUS  Design 
Equations  Requires  Only  an  LQG  Software  Package  and 
Involves  Refinement  of  the  Optimal  Projection  r 
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desirable  case  for  practical  implementation,  there  exists  considerable  opportunity 
for  increased  computational  efficiency.  Furthermore,  and  most  satisfying,  the 
computational  complexity  dec reases  with  n^  as  is  intuitively  expected  below  that 
required  by  LQG  design.  Hence  the  optimal  projection  approach  has  computational 
complexity  less  than  LQG  reduction  methods  for  which  LQG  is  but  the  first  step. 

S.  Richter  ([23,A46])  has  developed  a  homotopy  algorithm  which  fully 
exploits  this  crucial  structure.  Numerical  experiments  thus  far  have  shown  that 
considerable  computat ional  savings  can  be  achieved  over  the  iterative  method. 
Furthermore,  by  applying  topological  degree  theory  to  investigate  the  branches  and 
character  of  the  local  extremals,  it  can  be  shown  that  the  maximum  number  of  possible 
extremals  is 


if  n^  £  min(n,m,l)  or  1  otherwise.  Hence  in  most  practical  cases  the  equations 
support  a  relatively  6mall  number  of  solutions. 

Both  the  iterative  method  and  the  homotopy  algorithm  have  been  applied  to  a 
design  problem  involving  an  8th-order  flexible  structure  originally  due  to  D.  Enns 
and  considered  in  flj.  Specifically,  a  variety  of  LQG  reduction  methods  are  compared 
in  [1]  for  a  range  of  controller  authorities.  These  methods  include: 

1.  Enns:  This  method  ia  a  f requency-weighted,  balanced  realization  technique 
applicable  to  either  model  or  controller  reduction. 

2.  Glover:  This  method  utilizes  the  theory  of  Hankel  norm  optimal 
approximation  for  controller  reduction, 

3.  Davis  and  Skelton:  This  is  a  modification  of  compensator  reduction  via 
balancing  which  addresses  the  case  of  unstable  controllers. 

4.  Yousuff  and  Skelton:  This  is  a  further  modification  of  balancing  for 
handling  stable  or  unstable  controllers. 


3. 


Liu  and  Anderson:  In  place  of  using  a  balanced  approximation  of  the 
compensator  transfer  function  directly,  this  method  approximates  the 
component  parts  of  a  fractional  representation  of  the  compensator. 
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All  of  the  above  method*  proceed  by  first  obtaining  the  full-order  LQG 
conpensator  design  for  a  high-order  state-space  model  and  then  reducing  the  dimension 
of  Che  resulting  LQG  compensator. 

Figure  34  summarizes  the  results  reported  in  [1]  for  the  above  LQG 
reduction  methods  along  with  results  obtained  using  the  iterative  method  for  solving 
the  optimal  projection  equations.  Here  q^  is  a  scale  factor  for  the  plant 
disturbance  noise  affecting  controller  authority.  Clearly,  LQG  reduction  methods 
experience  increasing  difficulty  as  authority  increases,  i.e.,  as  the  terms  become 
increasingly  more  important  in  coupling  the  control  and  reduction  operations.  For 
the  low  authority  cases,  the  optimal  projection  calculations,  which  were  performed  on 
a  Harris  H800  minicomputer,  appeared  to  incur  roughly  the  same  computational  burden 
as  the  LQG  reduction  methods.  Although  rhe  optimal  projection  computational  burden 
increases  with  authority,  comparison  with  rhe  LQG  reduction  methods  is  not  meaningful 
because  of  the  difficulty  experienced  by  these  methods  in  achieving  closed-loop 
stability.  See  [A44]  for  further  details  and  for  comparisons  involving  transient 
response. 


The  homotopy  algorithm  was  also  applied  to  the  example  considered  in  [1]. 
One  of  the  main  goals  of  the  development  effort  was  to  extend  the  range  of 
disturbance  intensity  or,  equivalently,  observer  bandwidth,  out  beyond  q^  ■  2000.  To 
this  end,  second-order  (n£  a  2)  controllers  were  obtained  with  relatively  little 
computation  for  q^  3  10,000,  100,000  and  1,000,000.  In  addition,  the  performance  of 
each  reduced-order  controller  was  within  2SZ  of  LQG.  These  cases  can  surely  be 
expected  to  present  a  nontrivial  challenge  to  both  the  LQG  reduction  methods  and  the 
iterative  optimal  projection  method. 

ttamerical  solution  of  the  robustified  optimal  projection  equations  has  been 
carried  out  for  several  examples.  For  illustrative  purposes  a  2x2  example  was 
considered  in  [A26]  and  the  results  illustrated  in  Figure  33  indicate  performance/ 
robustness  tradeoffs  possible.  The  variable  left-shift  technique  was  applied  in 
[A19]  to  the  NASA  SC0LE  problem  with  frequency  uncertainties.  The  robustness  of  LQG 
and  two  robustified  designs  is  shown  in  Figure  36.  The  plots  illustrate  the 
degradation  in  performance  due  to  simultaneous  perturbation  of  all  modal  frequencies. 
Nora  that  LQG  is  rendered  unstable  by  +5Z  frequency  perturbation  while  a  high- 
authority  robuatified  design  improves  this  region  ro  +81.  The  low-authority  design 
increases  this  region  significantly  while  sacrificing  6Z  nominal  performance. 
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The  closed-loop  system  is  stable 
Tba  closed-loop  system  is  unstable 


Figure  34.  The  Optimal  Projection  Approach  Uas  Compared  to 
Several  LQG  Reduction  Techniques  Over  a  Range  of  Controller 
Authorities  for  an  Example  of  Enns 


b«  Ab  (Aclub)  Vbllrt) 


Figure  35.  The  Robustified  Optimal  Projection  Equation*  Provide 
Robuatness/Perf ormance  Tradeoff*  for  a  Highly  Sensitive  Nooinal  LQG  Design 


RMS  LOS  ERROR  DEGRADATION  (X) 


Figure  36.  The  Strstonovich  Model  Robustifies  the 
LOG  Design  for  the  NASA  SCOLE  Model  with 
Uncertain  Modal  Frequencies 
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6.  Additional  Extensions 


The  robustified  optimal  projection  design  machinery  has  been  further 
extended  to  encompass  a  larger  number  of  design  cases  arising  in  practical 
application.  Here  we  merely  list  the  extensions: 

1.  Discrete-time  and  sampled-dara  controllers  ( [A2B.A30.A34.A3S] ) . 

2.  Decentralized  controllers  ((A39)). 

3.  Nonstrictly  proper  controllers  (IA371). 

4.  Distributed  parameter  systems  ((A251). 


7.  Concluding  Remarks 

The  machinery  provided  by  OPUS  for  designing  active  controllers  for 
flexible  structures  has  been  reviewed.  The  basic  machinery  is  a  system  of  coupled 
Riccati  and  Lyapunov  equations  which  directly  generalize  the  classical  LQG  result  to 
include  both  a  constraint  on  controller  order  and  a  model  of  parameter  uncertainty. 
The  overall  approach  thus  encompasses  all  major  design  tradeoffs  arising  in 
vibration-suppression  applications.  Substantial  numerical  experience  has  been  gained 
through  an  iterative  method  requiring  only  an  LQC  software  package  and.  more 
recently,  by  means  of  a  highly  efficient  hosiotopy  algorithm  developed  by  S.  Richter. 
The  overall  approach  opens  the  door  for  effective  design  of  impl ementable  controllers 
for  large  precision  space  structures. 

Acknowledgment.  He  wish  to  thank  Ms.  Jill  M.  Straehla  for  the  excellent 
preparation  of  this  paper. 
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Abstract — First-order  necessary  conditions  for  quadratically  optimal 
reduced-order  modeling  of  linear  time-invariant  systems  are  derived  in  the 
form  at  a  pair  of  modified  Lyaponov  equations  coupled  by  an  oblique 
projection  which  determines  the  optimal  reduced-order  model.  This  form 
of  the  necessary  conditions  considerably  simplifies  previous  results  of 
Wilson  |1|  and  clearly  demonstrates  the  quadratic  extremaiity  and 
nonoptimality  of  the  balancing  method  of  Moore  (2|.  The  possible 
existence  of  multiple  solutions  of  the  optimal  projection  equations  is 
demonstrated  and  a  relaxation-type  algorithm  is  proposed  for  computing 
these  local  extrema.  A  component-cost  analysis  of  the  model-error 
criterion  similar  to  the  approach  of  Skelton  |3|  is  utilized  at  each  iteration 
to  direct  the  algorithm  to  the  global  minimum. 

I.  Introduction 

THE  problem  of  approximating  a  high-order  linear  dynamical 
system  with  a  relatively  simpler  system,  i.e.,  the 
model-reduction  problem,  has  received  considerable  attention  in 
recent  years.  Among  the  myriad  papers  devoted  to  this  problem 
are  the  notable  contributions  of  Wilson  [1J.  Moore  [2],  and 
Skelton  [31  with  which  the  present  paper  is  concerned.  In  his  1970 
paper,  Wilson  proposed  an  optimality-based  approach  to  model 
reduction  which  involves  minimizing  the  steady-state,  quadrati¬ 
cally  weighted'  output  error  when  the  original  system  and 
reduced-order  model  are  subjected  to  white-noise  inputs.  For  the 
resulting  parameter-optimization  problem,  he  obtained  first-order 
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necessary  conditions  which  have  the  form  of  an  aggregation  (as, 
e.g.,  14])  and  which  involve  the  solution  of  two  Lyapunov 
equations  each  of  order  n  +  nm,  where  n  and  nm  are  the  orders  of 
the  original  and  reduced-order  models,  respectively  [5],  [6]. 

Some  time  later,  Moore  proposed  a  quite  different  approach  to 
model  reduction  based  upon  system-theoretic  arguments  as 
opposed  to  optimality  criteria.  Using  the  eigenvalues  of  the 
product  of  the  controllability  and  observability  gramians  (which 
satisfy  n  x  n  Lyapunov  equations),  his  method  identifies 
subsystems  which  contribute  little  to  the  impulse  response  of  the 
overal’  system.  Such  “weak"  subsystems  are  thus  eliminated  to 
obtain  a  reduced-order  model.  This  technique,  known  as  balanc¬ 
ing,  has  been  vigorously  developed  in  the  recent  literature  [7]— 

[11] .  Since  this  approach  is  completely  independent  of  optimality 
considerations,  there  is,  of  course,  no  expectation  that  such 
reduced-order  models  are  in  any  sense  optimal. 

A  third  approach  to  model  reduction,  proposed  by  Skelton  [3], 

[12] ,  also  utilizes  a  quadratic  optimality  criterion  as  in  [lj. 
However,  rather  than  proceeding  from  necessary  conditions  as 
does  Wilson,  Skelton  determines  for  a  given  basis  the  contribution 
(cost)  of  each  state  in  a  decomposition  of  the  error  criterion  and 
truncates  those  with  the  least  value.  Although  this  approach  is 
guided  by  optimality  considerations,  no  rigorous  guarantee  of 
optimality  is  possible  because  of  dependence  on  the  choice  of  state 
space  basis. 

The  present  paper  has  five  main  objectives,  the  first  of  which  is 
to  show  how  the  complex  optimality  conditions  of  Wilson  can  be 
transformed  without  loss  of  generality  into  much  simpler  and 
more  tractable  forms.  The  transformation  is  facilitated  by 
exploiting  the  presence  of  an  oblique  (i.e.,  nonorthogonal) 
projection  which  was  not  recognized  in  [  1  ]:  and  which  arises  as  a 
direct  consequence  of  optimality.  The  resulting  “optimal  projec¬ 
tion  equations"  constitute  a  coupled  system  of  two  n  x  n 

:  The  projection  was.  however,  pointed  out  in  [28.  p.  29J. 
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modified  Lyapunov  equations  (see  (2.13),  (2.14)  or  (2-21), 
<2.22)]  whose  solutions  are  given  by  a  pair  of  rank-n„  controlla¬ 
bility  and  observability  pseudogramians.  The  highly  structured 
form  of  these  equations  gives  crucial  insight  into  the  set  of  local 
extrema  satisfying  the  first-order  necessary  conditions. 

The  second  objective  of  the  paper  is  to  show  how  the  optimal 
projection  equations  provide  a  rigorous  extremality  context  for 
Moore’s  balancing  method  and  to  clearly  demonstrate  its  qua¬ 
dratic  nonoptimality.  Although  for  some  problems  the  "weak 
subsystem"  hypothesis  leads  to  a  nearly  optimal  reduced-order 
model,  we  construct  examples  for  which  the  reduced-order  model 
obtained  from  the  balancing  method  is  much  worse  with  respect  to 
the  least-squares  criterion  than  the  quadratically  optimal  reduced- 
order  model.  In  general,  all  that  can  be  said  is  that  the  presence  of 
a  weak  subsystem  indicates  that  the  reduced-order  model  obtained 
by  truncation  in  the  balanced  basis  may  be  in  the  proximity  of  an 
extremal  of  the  quadratically  optimal  model -reduction  problem; 
however,  this  extremal  may  very  well  be  a  global  maximum.  It 
should  be  noted  that  in  a  recent  paper  [13]  Kabamba  has  used 
bounds  on  the  model  error  to  demonstrate  the  quadratic  nonopti¬ 
mality  of  the  balancing  method. 

The  third  objective  of  the  paper  is  to  demonstrate  via  an 
example  the  mechanism  responsible  for  the  existence  of  multiple 
extrema  of  the  optimal  model-reduction  problem.  By  characteriz¬ 
ing  the  optimal  projection  as  a  sum  of  rank-1  eigenprojections  of 
the  product  of  the  rank-deficient  pseudogramians,  it  is  immedi¬ 
ately  clear  that  the  first-order  necessary  conditions  of  the  problem 
are  ambiguous  in  the  sense  that  they  fail  to  specify  which  nm 
eigenprojections  comprise  the  optimal  projection  corresponding  to 
a  solution  (i.e.,  global  minimum)  of  the  optimal  model-reduction 
problem.  Specifically,  since  the  pseudogramians  can  be  rank 
deficient  in  ("m)  =  n'./n„'.(n  —  nm)!  ways,  there  may  be  precisely 
this  many  extremal  projections  corresponding  to  an  identical 
number  of  local  extrema. 

The  fourth  objective  of  the  paper  is  to  propose  a  numerical 
algorithm  for  solving  the  optimal  projection  equations  by  exploit¬ 
ing  their  structure  and  taking  advantage  of  the  available  insights. 
By  expressing  the  modified  Lyapunov  equations  in  the  form  of 
"standard"  Lyapunov  equations,  an  iterative  relaxation -type 
algorithm  is  developed.  The  crucial  aspect  of  the  proposed 
algorithm  involves  extracting  an  oblique  projection  at  each  step 
from  the  product  of  the  solutions  of  the  Lyapunov  equations. 
Since  ("„m)  rank-/7„  projections  can  be  extracted  from  the  product 
of  two  n  x  n  positive-definite  matrices,  it  is  quickly  evident  that 
the  criterion  by  which  the  nm  eigenprojections  are  chosen 
determines  which  of  the  numerous  local  extrema  will  be  reached. 
If.  for  example,  the  projection  is  chosen  in  accordance  with  the  nm 
largest  eigenvalues  of  the  product  of  the  solutions  of  the  Lyapunov 
equations,  then  it  should  not  be  surprising  in  view  of  the  previous 
discussion  that  a  global  maximum  may  very  well  be  reached.  In 
this  case,  the  first  iteration  of  this  algorithm  involves  Lyapunov 
equations  whose  solutions  are  the  controllability  and  observability 
gramians  and  the  eigenvalues  in  question  are  precisely  the  squares 
of  the  second-order  modes  [2,  p.  24],  Thus,  the  first  iteration 
coincides  with  the  (nonoptimal)  balancing  approach  of  (2). 

Since  the  optimal  projection  equations  are  a  consequence  of 
inferential  (local)  properties,  it  should  not  be  expected  that  they 
alone  would  possess  the  inherent  ability  to  identify  the  global 
minimum.  Moreover,  because  of  the  number  of  local  extrema, 
second-order  necessary  conditions  appear  to  be  useless.  Instead, 
we  investigate  an  approach  which  chooses  the  eigenprojections 
according  to  a  component-cost  analysis  of  the  model-error 
criterion.  This  technique  can  lead  to  a  global  minimum  by 
effectively  eliminating  the  local  extrema  which  have  considerably 
greater  cost  than  the  global  minimum.  This  approach  is  philosoph¬ 
ically  identical  to  the  component  cost  analysis  of  Skelton  (3],  [12]. 
Essentially,  then,  component  cost  analysis  is  utilized  at  each 
iteration  to  direct  the  algorithm  to  the  global  minimum.  Although 
our  application  of  this  technique  is  admittedly  heuristic,  it  should 
be  noted  that  it  is  essentially  proposed  as  a  device  for  efficiently 


“sorting  out"  the  local  extrema  which  satisfy  the  otherwise 
mathematically  rigorous  necessary  conditions.  Hence,  we  propose 
component  cost  analysis  as  a  crucial  step  in  bridging  the  gap 
between  local  extremality  and  global  optimality. 

It  should  be  pointed  out  that  neither  the  numerical  algorithm 
proposed  in  this  paper  nor  the  iterative  algorithm  developed  in  [4] 
and  [5]  has  been  proven  to  be  convergent.  The  principal 
contribution  of  the  present  paper,  however,  is  not  a  particular 
proposed  algorithm  but  rather  the  revelations  concerning  the 
structure  of  the  first-order  necessary  conditions.  The  pro¬ 
posed  numerical  algorithm  should  be  considered  but  a  prelude  to  a 
full  investigation  into  numerical  algorithms  for  the  optimal 
projection  equations.  It  should  also  be  noted  that  the  presence  of 
the  optimal  projection  was  not  exploited  in  developing  the 
iterative  algorithms  in  [4]  and  [3]  (in  fact,  it  did  not  even  appear  in 
[1])  and  hence  crucial  insight  into  local  extrema  was  lacking. 

The  fifth  and  last  objective  of  the  paper  is  to  point  out  the 
connection  between  the  optimal  projection  equations  for  model 
reduction  obtained  herein  and  the  first-order  necessary  conditions 
obtained  recently  for  two  closely  related  problems,  namely, 
reduced-order  state  estimation  and  fixed-order  dynamic  compen¬ 
sation. 

The  plan  of  the  paper  is  as  follows.  Section  II  begins  with 
general  notation  and  definitions  followed  by  the  model-reduction 
problem  statement  and  the  main  theorem  which  presents  the 
optimal  projection  equations  for  model  reduction.  A  series  of 
remarks  considers  various  aspects  of  the  main  theorem  and  sets 
the  stage  for  discussing  connections  with  [1]  and  [2].  Section  III 
contains  a  detailed  discussion  of  the  sense  in  which  the  optimal 
projection  equations  simplify  the  necessary  conditions  given  in 
[1],  and  Section  IV  shows  how  the  approach  of  [2]  is  approxi¬ 
mately  extremal.  Section  V  presents  a  simple  example  which 
clearly  displays  the  possible  existence  of  multiple  extrema 
satisfying  the  optimal  projection  equations.  This  example  shows 
that  the  balancing  method  of  [2]  may  lead  to  a  nonoptimal 
reduced-order  model  and  suggests  a  heuristic  procedure  for 
selecting  the  eigenprojections  comprising  the  projection  corres¬ 
ponding  to  the  global  minimum,  i.e.,  the  optimal  projection.  In 
Section  VI.  a  numerical  algorithm  for  solving  the  optimal 
projection  equations  is  proposed  and  applied  to  an  illustrative 
example  considered  previously  in  [1]  and  [2]  as  well  as  to  some 
interesting  examples  considered  recently  by  Kabamba  in  [13]. 
Related  results  on  reduced-order  dynamic  compensation  and  state 
estimation  are  briefly  reviewed  in  Section  VII  and  suggestions  for 
further  research  are  given  in  Section  VIII.  The  proof  of  the  main 
theorem  appears  in  the  Appendix. 

II.  Problem  Statement  and  Main  Result 


The  following  notation  and  definitions  will  be  used  throughout 
the  paper: 


l, 

ZT 

z  T 

p(Z) 
tr  Z 

IIZII 

Z, 

diag  (of|,  ar) 

E 


si.  trs 

stable  matrix 

nonnegative-definite 

matrix 

positive-definite 

matrix 


r  x  r  identity  matrix 
transpose  of  vector  or  matrix  Z 

(Z7)-'  or(Z-')r 
rank  of  matrix  Z 
trace  of  square  matrix  Z 
[tr  ZZT]'a 

(/,  y'j-element  of  matrix  Z 

r  x  r  diagonal  matrix  with  listed 

diagonal  elements 

matrix  with  unity  in  the  (/,  /) 

position  and  zeros  elsewhere 

expected  value 

real  numbers,  r  x  s  real  matrices 
matrix  with  eigenvalues  in  open 
left  half  plane 
symmetric  matrix  with 
nonnegative  eigenvalues 
symmetric  matrix  with  positive 
eigenvalues 
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semisimple  matrix 

nonnegative 
semisimple  matrix 
positive-semisimple 
matrix 

positive-diagonal 
matrix 
n,  m,  t,  nm 
Wt  y,  xmi  yn i 
A,  B,  C 
Am,  Bm,  Cm 

R,  V 


matrix  similar  to  a  diagonal  matrix 
[14.  p.  101 

matrix  similar  to  a  nonnegative- 
definite  matrix 
matrix  similar  to  a  positive- 
definite  matrix 
diagonal  matrix  with  positive 
diagonal  elements 
positive  integers,  1  s  nm  £  n 
n,  m,  l,  nm,  f-dimensional  vectors 
nxn,  nxm,  fxn  matrices 
nm  x  nm,  nm  x  m,  t  x  nm 
matrices 

t  x  (,  m  x  m  positive-definite 
matrices 


We  consider  the  following  problem. 

Optimal  Model-Reduction  Problem:  Given  the  controllable 
and  observable  system 


x=Ax+Bu,  (2.1) 

y  =  Cx  (2.2) 

find  a  reduced-order  model 

Xm  ~  A  mxm  +  Bm  u ,  (2.3) 

ym  “  fjnXffl  (2.4) 


which  minimizes  the  quadratic  model-reduction  criterion3 
J(Am,  Bm,  Cm )  ilim  l(0'-y„)r/? (>->„)], 

f— • 

where  the  input  u(t)  is  white  noise  with  positive-definite  intensity 
V.  To  guarantee  that  J  is  finite,  it  is  assumed  that  A  is  stable  and 
we  restrict  our  attention  to  the  set  of  admissible  reduced-order 
models 


Q  A  {( A„ ,  Bm,  Cr,)  :  Am  is  stable}. 

Since  the  value  of  J  is  independent  of  the  internal  realization  of  the 
transfer  function  corresponding  to  (2.3)  and  (2.4),  we  further 
restrict  our  attention  to  the  set 

a.  -  {(A„,  Bm,  C„)€Q: 

•  ( Am ,  B„)  is  controllable  and  (Am,  Cm)  is  observable}. 

The  following  lemma  is  needed  for  the  statement  of  the  main 
result. 

Lemma  2.1:  Suppose  Q,  P  €  Ifl"*"  are  nonnegative  definite. 
Then  QP  is  nonnegative  semisimple.  Furthermore,  if  p(QP)  = 
nm  then  there  exist  G,  T  €  ®"i»  *"  and  positive-semisimple  M  G 
such  that 


QP=GTMY,  (2.5) 

fGr=/„m.  (2.6) 

Proof:  By  [14,  Theorem  6.2.5,  p.  123],  there  exists  n  x  n 
invertible  $  such  that  the  nonnegative-definite  matrices  Da  a 
and  Dp  4  I'  TPi  ~ 1  are  both  diagonal.  Hence,  DqDp  is 
nonnegative  definite  and  QP  -  &  ~'DqDp$  is  nonnegative 
semisimple.  Next  introduce  n  x  n  orthogonal  U  to  effect  a 
rearrangement  of  basis  if  necessary  so  that 

’  J  will  occasionally  be  referred  to  as  the  "model -reduction  error"  or. 
simply,  is  the  “cost." 


where  4>  A  and  nm  x  n„  A  is  positive  diagonal.  Hence,  for  all 
nm  x  nm  invertible  S. 

<?>>=*  [j]  (S- 'AS)!*' 1  0]*-' 

and  thus,  (2.5)  and  (2.6)  hold  with  G  =  [S1-  0)*r,  M  *  S''AS 
andT  *  [S-1  0]*-'.  ■ 

For  convenience  in  stating  the  main  theorem,  we  shall  refer  to 
G,  F  €  M"*  *"  and  positive-semisimple  M  €  satisfying 

(2.5)  and  (2.6)  as  a  (G,  M,  T)-factorization  of  QP.  Also,  define 
the  positive-definite  controllability  and  observability  gramians 

A  f"  eA'BVBTeAT‘  dt. 


WQ  A  eA  T,CTRCeA'  dt, 

Jo 

which  satisfy  the  dual  Lyapunov  equations 

0=AfVc+  WCAT+BVBT,  (2.7) 

0  *  A  TW0  +  W0A  +  CTRC.  (2.8) 

Main  Theorem:  Suppose  (Am,  Bm,  C„)  G  a*  solves  the 
optimal  model-reduction  problem.  Then  there  exist  nonnegative- 
defmite  matrices  0.  P  €  K"""  such  that,  for  some  (G,  M,  T)- 
factorization  of  QP,  Am,  Bm,  and  C„  are  given  by 

Am~rAGT,  (2.9) 

Bm  =  TB,  (2.10) 

Cm  =  CGT,  (2.11) 

and  such  that,  with  t  a  GtT,  the  following  conditions  are  sati.  fled: 

p(<2)  =  p(P)~  p(QP)  =  nm,  (2  12) 

0  =  t[AQ+Qat+BVBt],  (2.1?) 

Q  =  [AtP+Pa  +  CtRC)t.  (2.1* ) 

Several  comments  are  in  order.  First,  note  that  the  main 
theorem  consists  of  necessary  conditions  in  the  form  of  two 
modified  Lyapunov  equations  (2.13)  and  (2.14)  plus  rank  condi¬ 
tions  (2.12)  which  must  possess  nonnegative-definite  solutions  Q, 
P  when  an  optimal  reduced-order  model  exists.  We  shall  call  Q 
and  P  the  controllability  and  observability  pseudogramians, 
respectively,  since  they  are  analogous  to  Wc  and  W„  and  yet  have 
rank  deficiency.  The  modified  Lyapunov  equations  are  coupled  by 
the  n  x  n  matrix  r  which  is  a  projection  (idempotent  matrix)  since 


rJ  =  GTTG7r  =  Cr/„mr  =  T. 

Note  that,  in  general,  t  is  an  oblique  projection  and  not 
necessarily  an  orthogonal  projection  since  it  may  not  be  symmet¬ 
ric.  We  shall  refer  to  a  projection  r  corresponding  to  a  solution 
(i.e.,  global  minimum)  of  the  optimal  model-reduction  problem  as 
an  "optimal  projection."  It  should  be  stressed  that  the  form  of  the 
optimal  reduced-order  model  (2.7)— (2.9)  is  a  direct  consequence 
of  optimality  and  not  the  result  of  an  a  priori  assumption  on  the 
structure  of  the  reduced-order  model. 

Since  the  optimal  projection  equations  are  first-order  necessary 
conditions  for  optimality,  they  may  possess  multiple  solutions 
corresponding  to  various  local  extrema  such  as  local  maxima, 
local  minima,  saddle  points,  etc.  The  following  definition  will 
prove  useful. 

Definition  2.1:  Nonnegative-definite  (J,  P  G  Iff"”"  are 
extrema!  if  (2. 12)-(2. 14)  are  satisfied.  (Am,  Bm,  Cm)  G  Cl,  is 
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extremal  if  there  exist  extremal  <$,  P  such  that  {Am,  Bm,  Cm)  is 
given  by  (2.9)-(2.Il)  for  some  (G,  M,  r>- factorization  of  QP 
The  corresponding  projection  r  is  an  extremal  projection. 

Proposition  2.1:  Suppose  (Am,  Bm,  Cm)  is  extremal.  Then  the 
model-reduction  error  is  given  by  4 

J(Am,  Bm,  Cm) * 2tr  [ (CP-  W'WMi-  (2.15) 

Proof:  The  proof  is  given  at  the  end  of  Appendix  A.  ■ 
Remark  2.1:  Noting  the  identities 


STG,  M  =  S  ' MS  and  T  «  S'T.  Now  (2.19b)  follows  from 

r-c7r»GTr=+-,p2"  °j*.  ■ 

It  is  useful  to  present  an  alternative  form  of  the  optimal  model- 
reduction  equations  (2.13)  and  (2.14).  For  convenience,  define 
the  notation 

Tj.  4  I„-T. 


-2tr  l  Wc W0A 1  =  tr  [CTRCWc]  =  ts  [BVBTW0\,  (2.16)  Proposition  2.4:  Equations  (2.13)  and  (2.14)  are  equivalent, 

respectively,  to 

which  follow  from  (2.7)  and  (2.8),  (2.15)  can  be  written  for 

extremal  (Am,  Bm,  Cm)  as  0  =  AQ+QAT +BVBt-t1BVBtttl,  (2.21) 


J(Am,  Bm,  Cm)  =  2tr  [QPa  1  +  tr  [CTRCWc\ 


0  =  A  TP+  PA  +  CrRC- t]CtRCt,.  .  (2.22) 


=  2tr  {QPA\+tx  [BVBTW0 1.  (2.17) 

For  convenience  in  the  following  discussion,  let  Q,  P,  G,  M, 
T,  and  r  correspond  to  some  extremal  (Am,  B„,  Cm).  Now 
observe  that  if  x„  is  replaced  by  Sxm,  where  S  is  an  arbitrary 
nonsingular  matrix,  then  an  “equivalent”  reduced-order  model  is 
obtained  with  (Am,  Bm,  C„)  replaced  by  (S/l^S*1,  SB„, 
CmS-').  Since  J{A„,  Bm,  Cm)  =  /(SAmS  ',  SBm,  CmS-'),  one 
would  expect  the  main  theorem  to  apply  also  to  (SAmS'1,  SBm, 
C„S ' ').  Indeed,  the  following  result  shows  that  this  transforma¬ 
tion  corresponds  to  the  alternative  factorization  QP  = 
(S ~  TG)  T(SMS  ~  ')(ST )  and,  moreover,  that  all  (G,  M,  T)- 
factorizations  of  QP  are  related  by  an  invertible  transformation. 

Proposition  2.2:  If  S  €  ft"™*"*  is  invertible,  then  G  = 
S  TG,  T  =  ST  and  A/  =  SMS'  satisfy 

QP=GrMT,  (2.5)' 

r  GT=I„m.  (2.6)' 

Conversely,  if  G,  T  €  Iff'1™  *"  and  invertible  M  €  ft""*"™ 

satisfy  (2.5) '  and  (2.6) ' ,  then  there  exists  invertible  S  €  ft"™  x"™ 
such  that  G  =  S - rG,  T  =  ST  and  A/  =  SMS  '. 

Proof:  The  first  part  is  immediate.  The  second  part  follows 
by  taking  S  4  M~  lfGTM,  noting  S~'  =  MTGTM~l  and  using 
the  identities  TGTMTGT  =  M  and  MTGt  -  TGtM.  ■ 

The  next  result  shows  that  there  exists  a  similarity  transforma¬ 
tion  which  simultaneously  diagonalizes  QP  and  r. 

Proposition  2.3:  There  exists  invertible  ♦  €  ft"*"  such  that 

?]♦-'•  '’-♦'[o'  ?]♦•  «•>« 

oj*‘  oj*1  (2i9a-  w 

where  A^,  A/s  €  ft"™  *"™  are  positive  diagonal,  A  4  A^A p  and 
the  diagonal  elements  of  A  are  the  eigenvalues  of  M.  Conse¬ 
quently, 


Q=tQ,  P  =  Pt.  (2.20) 

Proof:  By  (14,  Theorem  6.2.5,  p.  123J,  and  by  (2.12),  there 
exists  n  x  n  invertible  ♦  such  that  (2.18)  holds  and  thus  (2. 19a) 
also  holds.  Define 


G  =  [/*„,  0]*T,  M=\  and  F  =  (/„„,  01+ 

so  that  (2.5)'  and  (2.6)'  are  satisfied.  By  the  second  part  of 
Proposition  2.2  there  exists  invertible  S  €  ft""  *"«  such  that  G  * 


4  The  expressions  (2.  !5)-(2. 17)  end  <2  23)-(2.24)  will  be  used  in  Sections 

V  and  VI. 


Proof:  By  (2.20),  (2.21)  =  (2.13)  +  (2.l3)r  +  (2.13)rand 
(2.13)  =  r(2.21).  Similarly,  (2.14)  and  (2.22)  are  equivalent.  ■ 
Remark  2.2:  Noting  the  identities 

-2  tr  [QPa}  =  xx  [CrKC(5)  =  tr  [BVBTP],  (2.23) 

which  follow  from  (2.20)-(2.22),  (2.17)  can  be  written  for 
extremal  (Am,  B„,  C„)  as 

J(Am,  Bm,  Cm)  =  tr  [Cr*C(fP’c-0)]-tr  [BVBT(W„  —  P)]. 

(2.24) 


To  facilitate  the  discussion  in  the  following  sections,  we 
consider  the  change  of  basis  i  4  ♦*,  where  ♦  is  given  by 
Proposition  2.3.  Writing  (2.1)  and  (2.2)  as 


k  =  AJt+6u, 

(2.25) 

y~d. 

(2.26) 

where 

A  4  ♦/)♦'',  6  4  C 

4  C*-', 

(2.9)-(2.U)  become 

Am  =  TAGT, 

(2.27) 

Bm  =  t6. 

(2.28) 

Cm-CGT, 

(2.29) 

where 

f  4  r*~',  G  4  C*T 

satisfy 

at- [V  J] .  rc'-i... 

(2.30) 

Note  that  (2.30)  implies 

r  =  (s  0J,  G  =  (S-r  01, 

(2.31) 

for  some  nm  x  n„  invertible  S.  Partitioning 

'-[*]•  A-[t  t]  ■ 

u  [a]  • 

<SiG™  Gj. 

where  J tm  G  Iff""  and  Am,  6„  and  Cm  are  nm  x  n 

™.  nm  x  mand 
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t  x  nm,  respectively,  (2.27M2.29)  and  (2.31)  yield 
Bm  =*  sSmi  Cm-cms-'. 

This  shows  that  the  optimal  reduced-order  model  (modulo  a  state 
transformation)  can  be  obtained  by  truncating  the  last  n  -  nm 
states  of  the  original  system  when  it  is  expressed  in  the  basis  with 
respect  to  which  Q  and  P  have  the  diagonal  forms 

[  «4  J]  -  [o'  2]  ■ 

Since  the  optimal  projection  r  has  the  simple  form 


in  this  basis,  we  shall  refer  to  (2.25)  and  (2.26)  as  an  optima! 
projection  realization  of  (2.1)  and  (2.2).  Note  that  when  (2.21) 
and  (2.22)  are  expanded  in  an  optimal  projection  basis  (i.e.,  a 
basis  corresponding  to  an  optimal  projection  realization)  they 

assume  the  form 

O^A^  +  KqAL+B^PI, 

(2.32) 

o^A2m\<l+6lv6Tm, 

(2.33) 

0 = A  Ijip + ApA  „  +  Clfi Cm , 

(2.34) 

o  =*  \pA„i + cyiCi. 

(2.35) 

If  ♦  in  Proposition  2.23  is  replaced  by 


which  corresponds  to  a  change  of  basis  for  the  reduced-order 
model  obtained  by  truncation,  then  Ag  and  A p  are  both  replaced 
by  (AgA/>)  'n  and  hence  this  can  be  called  a  balanced  optimal 
projection  basis,  utilizing  the  terminology  of  [2].  Thus,  in  a 
balanced  optimal  projection  realization,  Ag  and  A/s  appearing  in 
(2.32)-(2.35)  are  equal. 

The  next  result  provides  an  interesting  closed-form  characteri¬ 
zation  of  an  extremal  projection  in  terms  of  the  Drazin  generalized 
inverse  of  QP.  Since  (QP)2  =  GTM1T,  and  hence  p(QP)2  = 
p(QP),  the  “index”  of  QP  (see  (15,  p.  121])  is  1.  In  this  case, 
the  Drazin  inverse  is  traditionally  called  the  group  inverse  and  is 
denoted  by  (CP)'  115,  p.  124).  Since,  as  is  easily  verified,  (QP)’ 
=  GtM "T,  (2.6)  leads  to  the  following  result. 

Proposition  2.5:  An  extremal  projection  r  is  given  by 

r=QP(QP)'.  (2.36) 

An  alternative  representation  for  an  extremal  projection  will 
prove  useful  for  developing  a  numerical  algorithm  for  solving 
(2.21)  and  (2.22).  If  Q,  PE  11'*'  are  nonnegative  definite  then 
by  Lemma  2. 1  QP  is  nonnegative  semisimple  and  thus  there  exists 
invertible  ♦  €  li'*'  such  that 

QP  =  *-'Q*, 

where  (1  =  diag  («i,  •••,«,)  and  w,  a  0  are  the  eigenvalues  of 
QP  Now  define  the  r'th  eigenprojection  [16,  p.  41] 

n,«?P]  £*-'£,*, 

which  is  a  rank-1  oblique  projection.  Note  that  QP  has  the 
decomposition 

QP= £  «,n dQP). 

Jmt 


Proposition  2.6:  An  extremal  projection  r  is  given  by 

r-SHKM.  (2.37) 

i-  1 

where  the  r'th  eigenprojection  n AQP[  corresponds  to  the  ith 
nonzero  eigenvalue  X/  of  QP. 

HI.  Relationship  to  Wilson’s  Form  of  the  Necessary 
Conditions 

The  optimal  model-reduction  problem  considered  in  the  pre¬ 
vious  section  is  identical  to  the  problem  considered  by  Wilson  in 
[1]  with  the  minor  exception  that  he  sets  R  -  lt.  In  [1]  G  and  T 
are  denoted  by  fl2rand  0,,  (2.6)  appears  as  (15),  and  (2.9)-(2.11) 
are  given  by  (14a,  b).  Note  that  in  [1],  6,  and  02  depend  upon  the 
solutions  of  a  pair  of  (n  +  nm)  x  (n  +  n„)  Lyapunov  equations 
[see  (7),  (9)  of  [1]  or  (A. 2),  (A. 3)  of  the  present  paper]  whose 
coefficients  and  nonhomogeneous  terms  depend  in  turn  on  A„, 
Bm,  and  Cm[see(A.10)-(A.15)]-  The  advantage  of  the  n  x  n 
optimal  projection  equations  (2.21)  and  (2.22)  over  the  form  of 
the  necessary  conditions  given  in  [1]  [see  (A.  10)-(A.  15)]  is  that 
the  optimal  projection  equations  are  independent  of  A  m ,  Bm ,  and 
Cm .  Hence,  this  permits  the  development  of  numerical  algorithms 
which  avoid  the  need  to  choose  starting  values  for  A„,  Bm,  and 
Cm .  To  see  this,  note  that  although  the  unknowns  Am,  Bm,  and 
Cm  appear  explicity  in  (A.10)-(A.15),  all  data  in  the  optimal 
projection  equations  (2.13)  and  (2.14)  are  known  except  for  the 
solutions  Q  and  P.  Moreover,  the  optimal  projection  r,  which  was 
not  recognized  in  [1],  can  be  seen  to  play  a  fundamental  role  by 
coupling  the  modified  Lyapunov  equations  (2.21)  and  (2.22)  and 
determining  (since  r  =  Cyr)  Am,  Bm,  and  Cm  in  (2.7M2.9). 

IV.  Relationship  to  Moore's  Balancing  Method 

In  contrast  to  Wilson’s  method  for  model  reduction  which  is 
based  on  optimality  principles,  the  approach  due  to  Moore  [2] 
relies  on  system-theoretic  ideas.  The  main  thrust  of  this  approach 
“is  to  eliminate  any  weak  subsystem  which  contributes  little  to  the 
impulse  response  matrix”  [2,  p.  26].  The  concept  of  a  “weak 
subsystem”  is  defined  by  means  of  a  dominance  relation  [2,  p.  28] 
involving  similarity  invariants  called  second-order  modes.  Moore 
evaluates  reduced-order  models  obtained  in  this  way  by  comput¬ 
ing  the  relative  error  in  the  impulse  response  given  for  MIMO 
systems  by  [2,  p.  29] 

t(Am,  Bm,  Cm)  k  [  j|//,(/)||2  dt j  jj  || //(r)|| 2  dt  j  1/2 , 

where  H,(t)  k  H(t)  -  Hm(t),  H(t)  k  Rl,iCeA,BVul  and  Hm(t) 
k  R  l/2CmeA"’lBm  y'n.  To  discuss  this  approach  in  the  context  of  the 
optimal  model-reduction  problem,  we  assume  that  V  *  Im  and  R  = 
//■ 

Proposition  4.1:  Suppose  (Am,  Bm,  Cm )  E  Ct.  Then 
e(Am,  Bm,  Cm)  =  [~/(/l„,  Bm,  Cm)/ tr  (  We  W,A )] 1/2 

=  [/(/!„,  Bm,  Cm)/ tr  (CTRCWc)\ln 
=  [J(Am,  Bm,  Cm)/tr  (BK/rW'o)]"2.  (4.1) 

Proof:  The  result  follows  from  (A.l),  (A. 8),  and  (A.9) 
which  hold  without  regard  to  either  optimality  or  extremality.  ■ 

Note  that  Proposition  4.1  shows  that  the  relative  error  in  the 
impulse  response  is  minimized  precisely  when  J(Am,  Bm,  C*)  is 
minimized.  Actually,  this  result  is  to  be  expected  since,  as  shown 
in  [  1 },  J  can  be  obtained  alternatively  by  taking  u(t)  to  be  an 
impulse  at  l  =>  0. 

To  draw  interesting  comparisons  with  the  results  of  [2],  choose 
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n  x  n  invertible  ♦  such  that  ♦  lf/c'Jr7'and  t~TW0if-1  are  both 
diagonal  and  hence 


WCW0=  (4.2) 

where  £  k  diag  (cri,  ••• ,  <r„)  and  the  second-order  modes  o,  (i.e., 
the  positive  square  roots  of  the  eigenvalues  of  Wc  W0)  satisfy  <rt  fc  a2 
2:  •  •  •  a  o„  >  0.  This  transformation  corresponds  to  replacing 
(2.1).  (2.2)  by 


where  at/  >  0,  i  =  and  suppose  B  and  C  are  such  that 

BBr=  diag  {fix,  •••,  fiK),  CrC= diag  (y,,  •••,  >,), 

where  fit  >  0,  y>  >  0,  i  =  1,  •  •  •,  n.  Hypothesizing  diagonal 
solutions  @  and  P  of  (2.21)  and  (2.22)  leads  to 

A.  =  r^-5/. 

2a,  2a, 


x=Ax+Bu, 

(4-3) 

& 

ii 

(4.4) 

where 

Jf  k  *x,  A  k  'M*'1,  B  k  *B,  C  k  Clr'.  (4.5) 

The  transformed  system  (4.3),  (4.4),  called  a 
realization  [17],  can  further  be  chosen  so  that 

principal  axis 

(4.6) 

i.e..  the  balanced  realization.  Using  (4.5),  (2.7)  and  (2.8)  become 


where  each  6,,  i  =  1 ,  •  •  • ,  n  is  either  zero  or  one  and  exactly  nm 
of  the  S/s  are  equal  to  one.  Hence  r  =  diag  (5lt  •  •  •,  S„).  Note 
that  there  are  (Hm)  such  solutions  of  the  optimal  projection 
equations  corresponding  to  C,m)  local  extrema. 

Since 

Wc=  -X-a-'BBt,  W0m Q=tWc,  P=tW0 
and  A,  Wc,  and  W0  commute,  (2.15)  becomes 

J(Am,  Bm,  Cm)~  -i  tr  Tj,A~1BBtCtC. 


0  =  AZ  +  lAr+BYBr,  (4.7)  Hence 


0=^lr£  +  lU  +  <!,r/?C.  (4.8) 


The  model- reduction  procedure  suggested  in  [2]  involves 
partitioning 


C«[C.  C*l. 


where  Xm  €  iff"*  and  Am,  B„,  and  C„  have  corresponding 
dimension,  and  extracting  the  reduced-order  model  (Am,  Bm, 
C„).  Hence,  the  reduced-order  model  (Am,  Bm,  Cm)  is  extracted 
from  (4.3),  (4.4)  in  essentially  the  same  way  the  optimal  reduced- 
order  model  ( Am ,  Bm,  Cm)  is  extracted  from  (2.25),  (2.26).  To 
see  how  the  optimal-projection  realization  compares  to  a  princi¬ 
pal-axis  realization  first  note  that  (2.13)  and  (2.14)  are  satisfied 
by  Q  =  Wc  and  P  =  W0  when  the  rank  conditions  (2. 10)  are 
ignored.  Indeed,  since  Wc  and  W0  are  positive  definite,  the  rank 
conditions  (2.12)  do  not  hold.  If,  however,  the  system  (2.1),  (2.2) 
is  expressed  in  the  balanced  coordinate  system  (4.3),  (4.4)  (so  that 
Wc  =  WB  =  I),  then  the  assumption  o„m  >  <x_  *  (  implies  that 
p(IVc),  p{Wa)  and  p(tVc W0)  are  “approximately"  equal  to  n„ 
and  thus,  in  this  sense,  condition  (2.10)  is  satisfied.  This 
observation  leads  to  the  suggestion  that  when  o„m  >  o„m+x,  Wt 
and  W0  are  approximations  to  solutions  (2  and  P  of  the  optimal 
projection  equations  and  the  reduced-order  model  (Am,  Bm,  Cm) 
of  Moore  is  an  approximation  to  some  extremal  {Am,  Bm,  Cm). 
There  is  no  guarantee,  of  course,  that  any  particular  extremum 
corresponds  to  the  global  minimum,  or  even  to  a  local  minimum. 


J(Am.  Bm,  Cw)  =  £  fc(  1  -St),  (5.1) 

i-l 

where 


ti  £  0,7//2a,. 

To  minimize  J,  it  is  clear  that  6,  should  be  chosen  to  be  unity  for 
the  largest  nm  elements  of  the  set  {{V}”.,  and  zero  otherwise. 
Although  this  choice  is  not  necessarily  unique,  it  does  yield  a 
global  minimum.  Note  that  choosing  S,  =  1  is  equivalent  to 
selecting  a  particular  eigenprojection  II, [  Wc  W0]  corresponding 
to  the  eigenvalue  /3,y,  /4a(2. 

Remark  5.1:  The  expression  in  (5.1)  can  be  regarded  as  a 
decomposition  of  the  cost  in  terms  of  the  state  variables.  The  idea 
of  deleting  states  based  on  their  “component  costs"  is  precisely 
the  “component  cost  analysis"  approach  of  Skelton  [3],  [12]. 

Using  the  example,  it  is  easy  to  see  that  the  balancing  method  of 
[2],  which  selects  eigenprojections  based  upon  the  magnitude  of 
the  eigenvalues  of  WcWa,  i.e.,  the  (squares  of  the)  second-order 
modes,  may  yield  a  grossly  suboptimal  reduced-order  model.  To 
this  end,  let 

Oi  =  l,  a2  =  106,  J3i  =  l,  0j=lOs,  Tn  =  l,  y2=105 
so  that 

fi  =  0.5,  ft  =  500. 

Clearly,  J  is  minimized  ( J  =  ft)  by  choosing  6,  =  0,  =  1, 

which  corresponds  to  truncating  the  first  state  variable.  If, 
however,  the  method  of  [2]  is  utilized,  then  judging  by  the  second- 
order  modes 


V.  Existence  of  Multiple  Extrema  and  Component-Cost 
Ranking 

In  this  section,  we  show  by  means  of  a  simple  example  that  the 
optimal  projection  equations  may  possess  nonunique  solutions 
corresponding  to  multiple  extrema,  e.g.,  local  minima  or  max¬ 
ima.  We  also  show  how  decomposing  the  cost  can  identify  the 
global  minimum  from  among  the  numerous  extrema.  To  begin,  let 
m  =  t  =  n,  R  =  V  =  /„, 

A  k  diag  (-ai,  •  - a„ ), 


a, =0.5,  a2  =  (2.5)l/J  •  10-J»0.012, 

the  second  state  variable  should  be  deleted.  This,  however, 
corresponds  to  choosing  6t  =  1 ,  =  0  with  the  higher  cost  J  = 

ft.  The  fact  that  the  balancing  approach  of  [2]  fails  to  determine  a 
solution  of  the  optimal  model-reduction  problem  should  not  be 
surprising  in  view  of  the  fact  that  the  error  criterion  plays  no  role 
in  the  balancing  technique. 

Although  the  above  solution  exploited  the  simple  structure  ot 
this  example,  it  is  clear  that  choosing  the  global  minimum  from 
among  the  local  extrema  involves  an  eigenprojection  decomposi- 
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lion  of  the  cost  J.  To  extend  this  idea  to  more  general  systems,  e 
invoke  the  following  heuristic  approximation. 

Approximation  5.1:  Let  it  define  the  balanced  basis  as  in 
(4.6).  Then  ♦  also  approximately  defines  a  balanced  optimal 
projection  basis,  i.e., 

(5.2) 

where  extremal 

f  4  *T*-'=diag  (8„  •••,  6„)  (5.3) 

and 


8/€{0,  1}.  26'="- 

j-i 

Proposition  5.1:  If  Approximation  5.1  holds  for  extremal 
(A„,  Bm,  Cm)  then,  with  fx  4  /„  -  f, 

J(Am ,  Bm.  Cm)~  —  2tr 

(5.4) 

<•1 

Remark  5.2:  From  (4.7)  and  (4.8),  it  follows  that  (5.4)  can  be 
written  either  as 

J(Am,  Bm,  Cm)~ tr  [filBVB*] 

=  j^o,(BvBTU  1-6,)  (5.5) 

**  1 

or 

J(Am,  Bm.  Cm) m tr  I r\XCrRC] 

n 

=  ^<;l(Cr/?C)„(l-6,).  (5.6) 

<>i 

Hence,  Approximation  5. 1  leads  to  the  following  component-cost 
ranking  (again,  in  the  sense  of  Skelton  [3J,  [12J)  of  the  ("„„) 
extrema  satisfying  the  optimal  projection  equations. 

Component-Cost  Ranking:  Assume  Approximation  5.1  is 
valid  and  choose  the  eigenprojections  comprising  extremal  f  such 
that 

1,  if  -<r(  is  among  the  nm 

largest  elements  of  the  set  { 

6,  =  0,  otherwise. 

For  comparison  purposes,  we  shall  also  consider  the  following 
ranking  of  the  eigenprojections  based  upon  the  eigenvalues  of 
WCW0  (i.e.,  second-order  modes). 

Eigenvalue  Ranking:  Choose  the  eigenprojections  comprising 
extremal  f  such  that 

is  among  the  nm 

largest  elements  of  the  set  {  -  or} 

6(  =  0,  otherwise. 

Remark  5.3:  The  observation  that  the  second-order  modes 
alone  may  be  a  poor  guide  to  determining  an  optimal  reduced- 
order  model  has  recently  been  made  in  J 131  where  bounds  on  the 
model-error  criterion  were  given  involving  both  the  second-order 
modes  and  suitable  weights  called  balanced  gains.  It  can  be  seen 


m  Proposition  5.1  that  the  role  of  balanced  gains  in  our 
approach  is  played  by  the  elements  —  <r,v4  u  when  Approximation 
5. 1  holds.  It  can  also  be  seen  that  the  balanced  gains  of  Kabamba 
yield  bounds  on  the  component  costs  of  Skelton. 

VI.  Numerical  Solution  of  the  Optimal  Projection 
Equations 

Insofar  as  the  ultimate  aim  of  any  model-reduction  technique  is 
to  permit  the  development  of  numerical  procedures  for  reducing 
high-order  models,  the  optimal  projection  equations,  comprising  a 
coupled  system  of  modified  Lyapunov  equations,  appear  promis¬ 
ing  in  this  regard.  Therefore,  we  present  an  iterative  computa¬ 
tional  algorithm  that  exploits  the  structure  of  these  equations  and 
the  available  insights.  The  reader  is  strongly  reminded  tKat  the 
proposed  algorithm  is  but  a  first  attempt  at  solving  these  new 
equations  and  alternative  algorithms  may  yet  be  devised.  The 
basis  of  this  algorithm  is  the  ability  to  write  the  modified 
Lyapunov  equations  (2.21),  (2.22)  in  the  form  of  ’‘standard'* 
Lyapunov  equations  (6.1),  (6.2)  such  that  the  pseudogramians  Q 
and  P  are  extracted  at  the  final  step  (6.6).  It  follows  from  (2.32)- 
(2.35)  that  (2.21),  (2.22)  are  indeed  equivalent  to  (6.1),  (6.2) 
(with  k  *  oo)  and  (6.6). 

Algorithm: 

Step  I)  Initialize  r*0*  =  /„. 

Step  2)  Solve  for  £<*>,  /**» 

0  =  (A- r,*l4r<*l)(J<*>  +  Q,k\A  -  rik)Ai*k))T+BVBT,  (6. 1) 
0*(A  —  Tik)Arik))TA{k)  +  fi(k\A  —  Tik)Arlk))  +  CTRC.  (6.2) 
Step  3)  Balance 

*«*>(j“'(+«*>)’**  (*'*>)- 1  (63) 

X'*»*diag  (a',*’,  •••,  a,k)),  ••• 

Step  4)  If  k  >  1  check  for  convergence 

tr  (CTRCWc)-u  (Cr*CV'*><2«*>(r<*>)7')‘l 

tr  (CTRCWc)  J  '  l  * 

If  |  e*  -  e*_]  |  <  tolerance  then  go  to  step  8);  else  continue; 
Step  5)  Select  nm  eigenprojections 

4  +(ir,£, (*«*')''- 

Step  6)  Update 


r,**,,=  2  n,;  (6.5) 

r  ■  I 

Step  7)  Check  for  convergence;  if  not,  increment  k  and  return 
to  Step  2). 

Step  8)  Set 

(5=r‘"»(j(r<*')r,  ^  =  (r'“>)r/r<*».  (6.6) 

For  convenience,  we  shall  adopt  the  notation  (A<k\  B,k\  CJJ’). 
where  k  >  0,  to  denote  the  reduced-order  model  obtained  as  a 
result  of  applying  the  projection  tw,  and  we  define  (see  Section 
IV) 

4  *«*>.  O. 

i.e. ,  the  relative  error  associated  with  (A  JJ\  Cik)).  Note  that, 
in  general,  tk  *  ek  since  e,  denotes  the  relative  error  only  for  an 
extremum,  i.e.,  when  convergence  has  been  reached. 
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It  should  be  clear  from  the  discussion  in  the  previous  section 
that  the  crucial  step  of  the  algorithm  is  Step  5)— the  choice  of  the 
eigenprojections.  For  the  examples  which  follow,  we  shall  invoke 
consistently  at  Step  S)  either  the  component-cost  ranking  based 
upon  Approximation  5.1  or  the  eigenvalue  ranking. 

Remark  6.1 :  Note  that  in  the  special  case  R  *  Im  and  V  =  /,. 
the  first  iteration  of  the  algorithm  yields  Qm  ■>  Wc,  A°>  *  W0. 
If,  at  Step  5),  we  choose  i,  -  r,  r  «  nm,  i.e.,  the 

eigenprojections  are  selected  according  to  the  eigenvalue  ranking, 
then  C^')  is  precisely  the  reduced-order  model 

obtained  from  balancing. 

We  shall  first  consider  the  following  example  which  was  treated 
by  both  Wilson  and  Moore.  In  this  example,  and  those  that  follow, 
assume  R  *>  /*,  V  -  I,. 

Example  6.1: 


0  0  0 

-150 

4 

A  = 

1  0  0 

0  1  0 

-245 

-113 

,  B= 

1 

0 

0  0  1 

-19 

0 

Table  I  summarizes  the  results  obtained  for  the  three  cases  n„ 
*  3,  2,  1  utilizing  the  eigenvalue  ranking.  In  each  case,  the 
proposed  algorithm  converged  linearly  in  less  than  eight  iterations 
and,  in  each  case,  improvement  is  evident  oyer  previously 
published  results.  As  pointed  out  in  [2],  Wilson’s  result  seems  to 
imply  a  lack  of  final  convergence.  For  this  example,  the  balancing 
approach  yields  a  reduced-order  model  close  to  the  global 
minimum. 

We  now  turn  to  a  pair  of  interesting  examples  considered  in 

I13J- 

Example  6.2: 

[-0.005  -  0.99]  [  1  ]  C_RT 

[-0.99  -  5000J  ’  "  [looj  ’  ■ 

Table  II  summarizes  the  results  obtained  using  the  eigenvalue 
ranking  and  Table  III  gives  the  results  when  the  component-cost 
ranking  is  used.  It  is  dear  that  the  former  method  directs  the 
algorithm  to  the  global  maximum  whereas  the  latter  approach 
yields  the  global  minimum. 

Example  6.3: 

Table  IV  reports  the  results  obtained  using  either  the  compo¬ 
nent-cost  ranking  or  the  eigenvalue  ranking  which  agree  for  this 
example.  If  the  alternative  eigenprojection  is  selected  then,  as 
expected,  the  algorithm  converges  to  a  global  maximum  (see 
Table  V).  The  interesting  aspect  of  this  example,  as  discussed  in 
(13J,  is  the  error =  0.5245  (see  (13])  for  the  reduced-order 
model  obtained  by  either  eigenprojection  ranking  is  actually 
greater  than  ci  =  0.3849  obtained  by  choosing  the  alternative 
reduced-order  model.  This  situation  seems  to  indicate  that  proper 
eigenprojection  selection  based  upon  a  cost  decomposition  is  able 
to  direct  the  algorithm  to  the  global  minimum  in  cases  for  which 
the  starting  values  are  not  nearby. 

VII.  The  Optimal  Projection  Equations  for  Fixed-Order 
Dynamic  Compensation  and  Reduced-Order  State 
Estimation 

We  briefly  discuss  the  relationship  between  the  optimal 
projection  equations  for  model  reduction  and  analogous  results  for 
reduced-order  control  and  estimation  problems. 

Fixed-Order  Dynamic-Compensation  Problem:  Given  the 
controlled  system 

x=Ax  +  Bu  +  W|,  (7.1) 

y=Cx+w2,  (7.2) 


TABLE  I 

RELATIVE  ERROR  f.  «  t. 


Order  nm 

Wilson  [1] 

Moore  (2) 

Optimal  Projection 
Equations 

3 

0.001311 

0.001306 

2 

0.04097 

0.03938 

0.03929 

1 

— 

0.4321 

0.4268 

TABLED 

EXAMPLE  6.2  WITH  EIGENVALUE  RANKING 


k 

ri 

1 

0.9950371897 

2 

0.9950371691 

3 

0.9950371690 

TABLE  ID 

EXAMPLE  6.2  WITH  COMPONENT-COST  RANKING 


k 

e, 

1 

0.0995037 

2 

0.0995449 

3 

0.0995924 

4 

0.0996520 

5 

0.0997346 

6 

0.0998648 

7 

0.1001125 

8 

0.1007724 

9 

0.1054569 

10 

0.0982006 

11 

0.0975409 

12 

0.0975342 

13 

0.0975330 

14 

0.0975329 

TABLE  IV 

EXAMPLE  6.3  USING  EITHER  RANKING 


k 

6 

1 

0.646996 

2 

0.418341 

3 

0.220994 

4 

0.177276 

5 

0.176576 

TABLE  V 

EXAMPLE  6.3  WITH  THE  OPPOSITE  RANKING 


*  «* 


1 

0.7624928516 

2 

0.9999999961 

3 

0.9999999975 

29 

0.9999999999 
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design  a  fixed-order  dynamic  compensator 

*c~AeXc+Bcy,  (7.3) 

u-Ce xe  (7.4) 

which  minimizes  the  performance  criterion 

J(Ae,  Bc,  Cc)  4  lim  t[jcrR|Jr+uTR:u],  (7.5) 

l—m 

where  u  €  US'",  xc  €  ft”'.  nc  s  n,  tv,  is  white  disturbance  noise, 
tv2  is  nonsingular  white  observation  noise,  R,  is  nonnegative 
definite,  and  Ri  is  positive  definite. 

Necessary  conditions  characterizing  optimal  (Ac,  Bc,  Ce)  have 
been  developed  in  [18]-[22]  along  the  same  lines  as  the  main 
theorem.  These  conditions,  called  the  optimal  projection  equa¬ 
tions  for  fixed-order  dynamic  compensation,  consist  of  four 
matrix  equations  (two  modified  Riccati  equations  and  two 

modified  Lyapunov  equations)  coupled  by  a  projection.  The 
modified  Riccati  equations,  not  surprisingly,  are  similar  in  form 
to  the  covariance  and  cost  Riccati  equations  of  LQG  theory  and 
the  modified  Lyapunov  equations  are  similar  to  the  optimal 
model-reduction  equations  (2.13)  and  (2.14).  Hence,  while  the 
modified  Riccati  equations  govern  optimal  estimation  and  optimal 
control,  the  additional  modified  Lyapunov  equations  characterize 
“optimal  reduction.”  The  important  fact  that  all  four  equations 
are  coupled  supports  the  view  that  optimal  fixed-order  dynamic 
compensators  cannot,  in  general,  be  designed  by  means  of  a 
stepwise  procedure,  e.g.,  by  either  open-loop  model  reduction 
followed  by  LQG  or  LQG  followed  by  closed-loop  model 
reduction. 

Midway  between  the  model-reduction  and  fixed-order  dy¬ 
namic-compensation  problems  lies  the  following  problem. 

Reduced-Order  State-Estimation  Problem:  Given  the  ob¬ 
served  system 


x=*Ax+y/\, 

(7.6) 

y=Or+  wj. 

(7.7) 

design  a  reduced-order  state  estimator 

x,=A*,  +  Bty, 

(7.8) 

yr = c,x„ 

(7.9) 

which  minimizes  the  estimation  criterion 

J(A„  Bt,  Ct)  4  lim  WLx-y,)TR(Lx-yt)), 

r— • 

where  x,  G  K"»,  L  and  L  identifies  the  states,  or  linear 

combinations  of  states,  whose  estimates  are  desired.  The  order  n, 
of  the  estimator  state  x,  is  determined  by  implementation 
constraints,  i.e.,  by  the  computing  capability  available  for 
realizing  (7.8)  and  (7.9)  in  real  time. 

In  view  of  the  results  already  given,  it  should  not  be  surprising 
(see  (23])  that  the  optimal  projection  equations  for  reduced-order 
state  estimation  form  a  system  of  three  matrix  equations  (a  pair  of 
modified  Lyapunov  equations  along  with  a  single  modified  Riccati 
equation)  coupled  by  a  projection  which  determines  the  gains  of 
the  optimal  reduced-order  estimator.  This  intrinsic  coupling 
between  the  "operations”  of  optimal  estimation  (the  modified 
Riccati  equation)  and  optimal  model  reduction  (the  pair  cf 
modified  Lyapunov  equations)  stresses  the  fact  that  reduced-order 
estimators  designed  by  means  of  either  model  reduction  followed 
by  “full-order"  state  estimation  or  full-order  estimation  followed 
by  estimator  reduction  will  generally  not  be  optimal  for  the  given 
order. 

VIII.  Directions  for  Further  Research 

The  most  important  area  of  research  involves  the  further 
development  of  algorithms  for  solving  the  optimal  projection 
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equations.  Although  proving  local  convergence  of  the  proposed 
algorithm  appears  possible,  the  more  important  problem  is 
achieving  global  optimality  via  the  component  cost  approach. 
Although  die  global  minimum  was  attained  for  all  examples 
attempted  by  the  authors,  it  remains  to  treat  considerably  more 
complex  systems. 

An  interesting  extension  of  the  main  theorem  involves  the  case 
iii  which  the  original  system  (2  1),  (2.2)  is  a  distributed  parameter 
system,  e.g.,  a  partial  differential  equation  or  a  functional 
differential  equation.  This  generalization,  which  has  been  referred 
to  as  the  “ultimate  reduced -order  problem”  (24],  may  lead  to  the 
efficient  generation  of  high-order  discretizations  for  such  systems. 
All  of  the  mathematical  machinery  required  to  generalize  the  main 
theorem  to  this  case  has  already  been  applied  to  fixed-order 
dynamic  compensation  in  [25]. 

IX.  Conclusion 

First-order  necessary  conditions  for  quadratically  optimal 
reduced-order  modeling  of  a  linear  time-invariant  plant  are 
expressed  in  the  form  of  a  pair  of  n  x  n  modified  Lyapunov 
equations  coupled  by  an  oblique  projection.  This  form  of  the 
necessary  conditions  considerably  simplifies  the  original  form 
given  by  Wilson  in  [1]  and  clearly  reveals  the  possible  presence  of 
numerous  extrema.  The  balancing  method  of  Moore  given  in  (2] 
is  shown  to  yield  a  reduced-order  model  that  is  “close”  to  an 
extremal  given  by  the  necessary  conditions.  A  numerical  example 
shows,  however,  that  this  extremal  may  very  well  be  the  global 
maximum  rather  than  the  desired  global  minimum.  An  algorithm 
is  proposed  which  exploits  the  presence  of  the  optimal  projection 
and  computes  the  various  local  extrema  by  the  choice  of 
eigenprojections  comprising  the  projection.  A  component-cost 
ranking  of  the  eigenprojections,  which  is  very  much  in  the  spirit  of 
Skelton's  method  in  [3]  and  [12],  is  used  to  direct  the  algorithm  to 
the  global  optimum. 

It  should  be  pointed  out  that  Moore’s  balancing  appears  to  have 
strong  ties  with  the  L„  reduction  problem  via  the  Hankel  norm 
[29] .  Alternative  settings  for  the  Hankel  operator,  however,  seem 
to  indicate  connections  to  the  quadratic  problem  [30] .  Finally,  the 
robustness  problem  for  reduced-order  modeling,  estimation,  and 
control  in  a  quadratic  setting  is  discussed  in  [31]. 

Appendix 

Proof  of  the  Main  Theorem 

Introducing  the  augmented  system 
i-Ax+Bu, 

P=Cx, 

where 

i4U]'  ? 

Ai[AC  l]  ■  e“  [/„]  •  -c-l- 

leads  to  the  expression 

J(Am,  Bm ,  Cm)  =  tr  QB,  (A.  1) 

where  ft  4  CTRC  and  the  nonnegative-definite  steady -state 
covariance  of  ^  is  given  by  the  (unique)  solution  of 

0  =  AQ+QAT+P,  (A. 2) 

with  P  4  B  VBT.  To  minimize  (A.l)  subject  to  the  constraint  (A. 2). 
form  the  Lagrangian 

L(Am,  Bm,  Cm,  Q)  4  tr  |X<?£+  (■*£+  QAT  +  P)P\ 
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with  multipliers  X  2  0  and  P  €  $]<»•►  Since  0t+  is  an 

open  set,  the  standard  Lagrange  multiplier  rule  can  be  applied. 

Using  formulas  for  computing  partial  derivatives  [26],  it 
follows  that 


0  =  ATP+ PA+\P. 

Since  X  =  0  implies  P  =  0  (recall  A  is  stable),  we  can  take  X  =  1 
without  loss  of  generality.  Hence,  P  is  the  (unique  nonnegative- 
definite)  solution  of 


0=ATP+PA+P.  (A.3) 

Again  using  formulas  from  [26]  and  performing  some  manipula¬ 
tion,  it  follows  that 


0  *  LAm  =  Q  ^  P12  +  (?2  Pi , 
0=LBm  =  2(Pl2B  +  P1Bm)V, 
0-  =  2P(CmQj  -  CQi2), 

where  Q  and  P  have  been  partitioned  as 


r Q> 

Q» 1 

Pjpt 

Ptl 

Lor: 

Qi}' 

L'S 

Pi 

(A  .4) 
(A. 5) 
(A.6) 


(A. 7) 


Computing  (A.19)~r(A.18)  implies 

Am  =  YAQYT(TQTTyx 

which,  since  TQTT  =  Q2,  yields  (2.9).  Alternatively,  (2.9)  can 
be  obtained  from  (A.21)-G(A.20). 

If  we  now  substitute  (2.9)  into  (A.  18)— (A.21)  and  use  the  easily 
verified  relations  (2.20),  it  follows  that  (A.  19)  =  F(A.18)  and 
(A.22)  =  G(A.21),  and  thus  (A.  19)  and  (A.21),  are  redundant. 
Finally,  Gr(A.18)rand  (A.20)r  yield  (2.13)  and  (2.14),  respec¬ 
tively.  Note  that  these  last  multiplications  entail  no  loss  of 
generality  since  p(G)  =  p(D  =  nm . 

To  show  that  the  optimal  projection  equations  entail  no  loss  of 
generality  over  (A.2)-(A.6),  let  (5,  P  be  extremal  and  define  Ql2, 
Q2,  P\i,  Pi  by  (A.16)  and  (A. 17)  for  some  (G,  M,  T)- 
factorization  of  QP,  and  let  Qu  Pt  satisfy  (A. 10)  and  (A. 13). 
Then  it  is  straightforward  to  reverse  the  steps  taken  in  the  proof  to 
arrive  at  (A.2)-(A.6).  ■ 

Proof  of  Proposition  2.1:  Extremal  Q,  P  leads  to  Q,  P  as 
in  (A. 7)  satisfying  (A.2)-(A.6).  Computing 

J(A„,  Bm,  Cm)  =  tr  (QtCTRC-2Ql2CJnRC)  +  tr  (Q2CTJtCm) 

=  tr  [CTRC(Wc-Q)], 

noting  that  (2.13),  (2.14)  are  equivalent  to  (2.21),  (2.22)  because 
of  (2.20)  and  using  (2.23),  leads  to  (2. IS).  ■ 


Since  (as  will  be  seen  shortly)  Q2  and  P2  are  positive  definite, 
define 

C  £  Q;'Q [2.  r  £  -Pi'P;},  (A.8) 

so  that  (A.4)-(A.6)  become  (2.6),  (2. 10)  and  (2.11),  respectively. 
Next,  define  the  nonnegative-defmite  matrices 

<2  4  QmQ2'Q\v  P  4  PnP-'PTn  (A.9) 

and  note  that  (A.4)  implies  that  (2.5)  holds  with  M  £  Q2P2.  Since 
QiPi  =  P2  1Q1P2l)P\n,  M  is  positive  semisimple .  The  rank 

conditions  (2.12)  follow  from  Sylvester's  inequality.  Expanding 
(A.2)  and  (A.3)  yields 


0  =  AQi  +  QiAr+BVBT, 

(A.  10) 

^AQn  +  Qr.Al+BVBl 

(A. 11) 

0  =  AmQ2  +  Q2Ar+BmVBrm, 

(A.  12) 

0 =AtP,+P,A  +  CtRC. 

(A.  13) 

Q  =  ArPi2  +  P\2Am-CTRCm, 

(A.  14) 

0=ArJ>2  +  P2Am  +  ClflCm. 

(A.  15) 

Since  Am  is  stable  and  (Am,  Bm)  is  controllable,  standard  results 
(e.g.,  [27,  p.  277])  imply  that  Qi  is  positive  definite.  Similarly,  P2 
is  positive  definite. 

It  is  easy  to  see  at  this  point  that  Am,  Bm,  and  Cm  are 
independent  of  Qx  and  P,  and  thus  (A.  10)  and  (A.  13)  can  be 
ignored.  Now,  substituting  (2.10),  (2.11)  and  the  identities 


Qn  =  CrT,  PU=-PGT,  (A.16) 

Qi  =  TQTT,  Pi  =  GPG  t,  (A. 17) 

into  (A. 11),  (A. 12),  (A. 14),  and  (A. IS)  yields 

0  =  AQrT+GrTAZ+BVBrTT,  (A. 18) 

o-AmrQrT+rQrTAZl+rBVBTTT%  (A.i9j 

0  =  ATPGT+PGTAm  +  CTRCGT,  (A.20) 

0  =  AjfiPGr+GPGTAm  +  GCrRCGT.  (A.21) 
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The  Optimal  Projection  Equations  for  Reduced-Order 
State  Estimation 

DENNIS  S.  BERNSTEIN  and  DAVID  C.  HYLAND 

Abstract — First-order  necessary  conditions  tor  optimal,  steady-state, 
red aced -order  state  estimation  for  a  linear,  time-invariant  plant  in  the 
pretence  of  correlated  disturbance  and  nonsingnlar  measurement  noise 
are  derived  in  a  new  and  highly  simplified  form.  In  contrast  to  the  lone 
matrix  Riccati  equation  arising  in  the  full-order  (Kalman  filter)  case,  the 
optimal  steady-state  reduced-order  estimator  is  characterised  by  three 
matrix  equations  (one  modified  Riccati  equation  and  two  modified 
Lyapunov  equations)  coupled  by  a  projection  whose  rank  is  precisely 
equal  to  the  order  of  the  estimator  and  which  determines  the  optimal 
estimator  gains.  This  coupling  is  a  graphic  reminder  of  the  suboptimality 
of  proposed  approaches  involving  either  model  reduction  followed  by 
“full-order’*  estimator  design  or  full-order  estimator  design  followed  by 
estimator-reduction  techniques.  The  results  given  here  complement 
recently  obtained  results  which  characterize  the  optimal  reduced-order 
model  hy  means  of  a  pair  of  coupled  modified  Lyapunov  equations  |7J 
and  the  optimal  fixed-order  dynamic  compensator  by  means  of  a  coupled 
system  of  two  modified  Riccati  equations  and  two  modified  Lyapunov 
equations  Id. 

I.  INTRODUCTION 

It  has  recently  been  shown  (see  [I J-f7|)  that  the  first-order  necessary 
conditions  for  the  problems  of  optimal  model  reduction  and  optimal  fixed- 
order  dynamic  compensation  can  be  formulated  in  terms  of  an  “optimal 

Manuscript  received  June  28.  1984;  revised  September  14,  1984.  This  work  was 
supported  in  part  by  Lincoln  Laboratory.  M.t.T. 
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j  projection"  matrix  which  arises  as  a  direct  consequence  of  optimality. 

I  These  necessary  conditions,  by  virtue  of  their  remarkable  simplicity, 
(.yield  insight  into  the  structure  of  the  optimal  design  and  permit  the 
i  development  of  alternative  numerical  algorithms  (2],  (4],  (7],  The 
I  purpose  of  this  note  is  to  develop  analogous  first-order  necessary 
:  conditions  for  the  reduced -order  state-estimation  problem.  Since  this 
(  problem  falls  midway  between  the  problems  of  open-loop  model 
i  reduction  and  closed-loop  fixed-order  dynamic  compensation,  it  is  not 
|  surprising  that  the  necessary  conditions  for  these  problems  are  corre- 
;  spondingly  related.  Specifically,  while  the  optimal  projection  equations 
for  model  reduction  consist  of  a  system  of  two  matrix  equations  (a  pair  of 
1  modified  Lyapunov  equations)  and  the  optimal  projection  equations  for 
fixed-order  dynamic  compensation  comprise  a  system  of  four  matrix 
equations  (a  pair  of  modified  Lyapunov  equations  plus  a  pair  of  modified 
Riccati  equations),  the  optimal  projection  equations  for  reduced-order 
stale  estimation  form  a  system  of  three  matrix  equations  (a  pair  of 
modified  Lyapunov  equations  along  with  a  single  modified  Riccati 
equation).  In  each  case  the  system  of  matrix  equations  is  coupled  by  an 
1  oblique  projection  (idempotent  matrix)  which  determines  the  gains  of  the 
optimal  reduced-order  system,  whether  it  be  a  model,  estimator,  or 
compensator. 

The  need  for  designing  an  optimal  reduced-order  state  estimator  for  a 
high-order  dynamic  system  follows  directly  from  real-world  constraints 
on  computing  capability.  A  further  motivation  is  the  fact  that  although  a 
system  may  have  many  degrees  of  freedom,  it  is  often  the  case  that 
estimates  of  only  a  small  number  of  state  variables  are  actually  required. 
In  the  face  of  these  practical  motivations,  numerous  approaches  to 
designing  reduced-order  state  estimators  have  been  proposed.  See  [8]  for 
a  recent  review  of  previous  results. 

An  important  fact  pointed  out  in  [8]  and  [9]  is  that  reduced-order 
estimators  designed  by  means  of  either  model  reduction  followed  by 
“full-order”  state  estimation  or  full-order  estimation  followed  by 
estimator  reduction  will  not  be  optimal  for  the  given  order.  In  the  present 
paper  this  point  is  graphically  confirmed  by  the  fact  that  the  three  matrix 
equations  characterizing  the  optimal  reduced-order  state  estimator  reveal 
intrinsic  coupling  (via  the  optimal  projection)  between  the  “operations” 
of  optimal  estimation  (the  modified  Riccati  equation)  and  optimal  model 
reduction  (the  pair  of  modified  Lyapunov  equations). 

II.  Problem  Statement  and  Main  Result 

The  following  notation  and  definitions  will  be  used  throughout  the 


paper; 

",  l,  "„  P 

positive  integers.  1  s  n,  s  n 

x,  y,  x„  y. 

",  /.  "»,  /^-dimensional  vectors 

A,  C,L 

n  x  n,  1  x  ",  p  x  n  real  matrices 

A„  B„  C, 

n,  x  n„  ",  x  /,  p  x  ",  real  matrices 

w,(0,  t  £  0 

n -dimensional  white  noise  with  nonne¬ 
gative-definite  intensity  V, 

W2 (f),  /  2  0 

/-dimensional  white  noise  with  posi¬ 
tive-definite  intensity  Fj 

Vh 

n  x  /matrix  satisfying  I[wl(()w2(j)Tj 
*  VnW  -  s) 

R 

p  x  p  positive-definite  matrix 

I, 

r  x  r  indentity  matrix 

ZT 

transpose  of  vector  or  matrix  Z 

ZT 

(Z7)'lor(Z-')r 

SJl(Z),  <R(Z),  p(Z ) 

null  space,  range,  rank  of  matrix  Z 

I 

expected  value 

Ifi, 

real  numbers,  r  x  s  real  matrices 

stable  matrix 

matrix  with  eigenvalues  in  open  left 
half  plane 

nonnegative-defmite  matrix 

symmetric  matrix  with  nonnegative 
eigenvalues 

positive-definite  matrix 

symmetric  matrix  with  positive  eigen¬ 
values 

nonnegative-semisimple  matrix 

matrix  similar  to  a  nonnegative-defi¬ 
nite  matrix 
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positive-semisimple  matrix  matrix  similar  to  a  positive-definite 

matrix 

positive-diagonal  matrix  diagonal  matrix  with  positive  diagonal 

elements 

We  consider  the  following  optimal  reduced-order  state-estimation 
problem.  Given  the  system 

jt=/4x+w„  (2.1) 

y  =  Cx+w j,  (2.2) 

design  a  reduced-order  state  estimator 

i,=Apc,+Bj.  (2.3) 

y,-Or„  (2.4) 

which  minimizes  the  error  criterion 

AA„  B„  C,)  &  lim  mLx-y.)TR(Lx-yt)]. 

l—m 

In  this  formulation  the  matrix  L  identifies  the  states,  or  linear  combina¬ 
tions  of  states,  whose  estimates  are  desired.  The  order  n,  of  the  estimator 
state  x,  is  determined  by  implementation  constraints,  i.e.,  by  the 
computing  capability  available  for  realizing  (2.3),  (2.4)  in  real  time. 
Hence,  n,  is  considered  to  be  fixed  in  what  follows  and  the  problem  is 
concerned  with  determining  A„  B„  and  C,. 

To  guarantee  that  J  is  finite  it  is  assumed  that  A  is  stable  and  we  restrict 
our  attention  to  the  set  of  stable  reduced-order  estimators 

a  S  {(/4«,  B„  C ,)  :  A,  is  stable}. 

Since  the  value  of  J  is  independent  of  the  internal  realization  of  the 
transfer  function  corresponding  to  (2.3)  and  (2.4),  without  loss  of 
generality  we  further  restrict  our  attention  to  the  set  of  admissible 
estimators 

r .  4  {(/*„  b„  cjea: 

(A,,  B.)  is  controllable  and  (A,.  C,)  is  observable} . 

The  following  lemma,  whose  proof  is  given  in  (7],  is  needed  for  the 
statement  of  the  main  result. 

Lemma  2.1:  Suppose  Q,  P  €  11"*"  are  nonnegative  definite.  Then 
CP  is  nonnegative  semisimple.  Furthermore,  if  p(QP)  =  n„  then  there 
exist  G,  T  €  71"'*"  and  positive-semisimple  M  €  71"**"'  such  that 

CP=GTMT,  (2.3) 

rGr=/„,.  (2.6) 

For  convenience  in  stating  the  Main  Theorem  we  shall  refer  to  G,  T  G 
'Iff  **  and  positive-semisimple M  €  71"'“"'  satisfying  (2.5)  and  (2.6)  as  a 
(G,  M,  r)-factorization  of  CP-  Furthermore,  define  the  notation 

r  £  G 7.  rx  &  /„-r 

and 

ft  6  go  y,2. 

where  Q  G  71"'". 

Main  Theorem:  Suppose  (A„  B„  C, )  G  (J,  solves  the  optimal 
reduced-order  state-estimation  problem.  Then  there  exist  nonnegative- 
definite  matrices  Q.  Q.  P  6  such  that,  for  some  (G,  M.  D- 
factorization  of  QP,  A„  B„  and  C,  are  given  by 

A,~r{A-Q.Vi<OGr.  (2.7) 

fi.»rftf'!-',  (2.8) 

C,=LGT  (2.9) 

and  such  that  the  following  conditions  are  satisfied- 

0 -AQ+QAr+  I'.-ftF,  'ftr+r1ftKj 'ftrr'  ,  (2.10) 


0-/f^  +  <J/t'-+ftKf1ftI--r,ftf'j-'ftVI,  (2.11) 

0  =  (A  -  ftF’f  'O TP+  P(A  -  ftKf  'O  +  L  TRL  -  r \L  TRLr, .  (2. 1 2) 

Pi&~(<P)=p(QP)  =  n,.  (2.13) 

Remark  2.1 :  It  is  useful  to  note  that  (2.7)  can  be  replaced  by 

,4,=I\4Gr-fl,CGr.  (2.7)' 

Remark  2.2:  Because  of  (2.6)  the  n  x  n  matrix  r  which  couples  the 
three  equations  (2. 10)— (2. 12)  is  idempotent,  i.e.,  t2  *  r.  In  general,  this 
“optimal  projection”  is  an  oblique  projection  (as  opposed  to  an 
orthogonal  projection)  since  it  is  not  necessarily  symmetric.  Note  that 
from  Sylvester’s  inequality  and  (2.6)  it  follows  that  p(r)  =  n,.  It  should 
be  stressed  that  the  form  of  the  optimal  reduced-order  estimator  (2.7)— 
(2 .9)  is  a  direct  consequence  of  optimality  and  not  the  result  of  an  a  priori 
assumption  on  the  structure  of  the  reduced-order  estimator. 

Remark  2.3:  To  obtain  the  standard  steady-state  Kalman  filter  result 
for  the  full-order  case,  set  p  =  n,  =  n  and  L  *=  Then  r  =  G  =  T  = 
/.  and  thus  (2.10)  reduces  to  the  standard  observer  Riccati  equation  [10, 
p.  367]  and  (2.7)  and  (2.8)  yield  the  usual  expressions.  Furtliermore,  it 
follows  from  (2.7)'  [11,  Lemma  2.1)  and  standard  results  that  (2.11)- 
(2.13)  are  equivalent  to  the  assumption  that  (A„  B„  C,)  is  controllable 
and  observable. 

Remark  2.4:  Since  QP  is  nonnegative  semisimple  it  has  a  group 
generalized  inverse  (CP)*  given  by  GTM  'T  (see,  e.g.,  [12,  p.  124)). 
Hence,  by  (2.6)  the  optimal  projection  r  is  given  by 

r  =  QP(QP)\  (2.14) 

Remark  2.5:  Replacing  x,  by  Sxr.  where  S  is  invertible,  yields  the 
“equivalent"  estimator  (S/4 ,5-',  SB,,  CJ' ').  Since  J(A„  B„  C,)  * 
J(SA£~ SB,,  Cr S'1),  one  would  expect  the  Main  Theorem  to  apply 
also  to  (SA^1.  SB,,  CpS" ').  This  is  indeed  the  case  since  transforma¬ 
tion  of  the  estimator  slate  basis  corresponds  to  the  alternative  factorization 
CP  *  (S  rG)r(SAfS  'Ksr) 

Remark  2.6:  Note  that,  for  the  optimal  values  of  A„  B„  and  C„  (2.3) 
assumes  the  observer  form 

x,  =  TAG Tx,  +  TftFj  >(y -  CGTx,).  (2.15) 


jf  *  r/4rf+  Tftt'j-  '(y-C2).  (2.16) 

Note  that  although  the  implemented  estimator  (2. 15)  has  the  state  x,  G 
H"',  (2.15)  can  be  viewed  as  a  quasi-full-order  estimator  whose  geometric 
structure  is  entirely  dictated  by  the  projection  r.  Specifically,  error  inputs 
ft l- 2"  'O'  -  Cif)  are  annihilated  unless  they  are  contained  in  [9T.(  r)]  = 

(Rfr2)-  Hence,  the  observation  subspace  of  the  estimator  is  precisely 
<R(rO- 

Remark  2.7:  Although  the  form  of  (2.16)  would  lead  one  to  surmise 
that  the  optimal  reduced-order  estimator  is  a  projection  of  the  optimal  full- 
order  estimator,  this  is  not  generally  the  case  for  the  following  simple 
reason.  In  the  full-order  case  Q  (which  appears  in  ft)  is  determined  by 
solving  a  single  Riccati  equation,  whereas  in  the  reduced-order  case  Q 
must  be  found  in  conjunction  with  Q  and  P  to  satisfy  all  three  matrix 
equations  (2. 10)— <2. 12).  Hence,  the  value  of  Q  in  the  reduced-order  case 
may  be  different  from  the  value  of  Q  in  the  full-order  case.  Thus.  (2. 16) 
may  not  be  obtainable  by  simply  projecting  the  full-order  result. 

To  further  clarify  the  relationship  between  Q.  P,  and  r,  we  now  show 
that  there  exists  a  similarity  transformation  which  simultaneously 
diagonalizes  QP  and  r. 

Proposition  2.1:  There  exists  invertible  ♦  G  It'”’  such  that 


C**-‘  J 

o°  j]  [o' 

:]* 

(2.17) 

<?/>=*- 

1  [;  s]  *•  1  [0 

:]* 

(M8a,b) 

By  introducing  the  quasi-full-state  estimate  2  &  GTx,  G  71"  so  that  tx  = 
2  and  x,  =  T2  G  71"',  (2.15)  can  be  written  as 
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where  A<j,  A/  €  U*'*"*  are  positive  diagonal,  A  4  A^A/s,  and  the 
diagonal  elements  of  A  are  the  eigenvalues  of  M.  Consequently, 

P‘Pr.  (2.19) 

m.  Proof  of  the  Main  Theorem 

The  proof  proceeds  exactly  as  in  (6].  Using  the  fact  that  d  *  is  open,  the 
Fritz  John  version  of  the  Lagrange  multiplier  theorem  can  be  used  to 
rigorously  derive  the  first-order  necessary  conditions 

0~AQ+QAT+P,  (3.1) 

0*ArP+PA  +  fi,  (3.2) 

0-P[2Qh  +  PiQs'  (3.3) 

- m 'PfjOi  +  Q^)CT+ Pi 'Pfj ^ j ' .  (3.4) 

C.~LQl2Qi\  (3.5) 

where 

A-f  A  0  1  pm  I"  V'  V"BT'  1 

[ftC  A.y  V  \_B,V>2  B,V2Bj\  • 

g  f  URL  -  L  TRC,  "I 
l  -CIRL  Cr,R2C,  J 

and  (n  +  n,)  x  (n  +  r,)(J,  £  are  partitioned  into  r  x  r,  a  x  r„  and  n, 
x  r,  subblocks  as 


[  Qi 

0.2 

fJr. 

Pis 

L  <?« 

Qt 

■  L's 

Ps 

Expanding  (3.1)  and  (3.2)  yields 

OmAQ,  +  Q,Ar+  Vu  (3.6) 

0  =  AQ,J  +  G.2A.r+e,(B,C)r+  VnBr..  (3.7) 

0  -A&  +  Qy 4  ;+  B/TG.j  +  Q^B.C)t+B,V2b;,  (3.8) 

0-Ar/>,  +  P,A  +(B,OtP\2  +  P»BJC+LtRL,  (3.9) 

0  mPl2A,  +  A  TP„  +  (fl^D  tP2  -  L  TRC„  (3.10) 

0  »  A  JP2  +  PiA,  +  ClR2C,.  (3.11) 

Note  that  (3  9)  is  superfluous  and  can  be  omitted.  Writing  (3.8)  as  (see 

U31.  (14]) 

0  -  (A,  +  B,CQuQi  )Q2  +  QAA,  +  B.CQ,2Qi  )r*B,  V2B[, 

where  Qi  is  the  Moore-Penrose  or  Drazin  generalized  inverse  of  Q2,  it 
follows  from  (II.  Lemmas  21  and  12.2)  that  Q2  is  positive  definite. 
Similarly,  (3.11)  implies  that  P2  is  positive  definite.  This  justifies  (3.4) 
and  (3.5). 

Now  define  the  r  x  r  nonnegative-definite  matrices  (see  1 13],  (14)) 

C-O.-O.1C2  'Ofr  <? -OuQt'Or,.  P-PnPi'PTn. 

and  note  that  (3.3)  implies  (2.5)  and  (2.6)  with 

c-Cr'Cfr  MmQ2p2,  r*  -Pi'PTn. 

Since  Q2P2  *  P2  "2(/^'1Qi/*]'I)F>i/1.  M  is  positive  semisimple.  Sylves¬ 
ter’s  inequality  yields  (2.13).  Note  (2.19)  and  the  identities 

Oi-O+0.  (3.12) 

Q.2  =  &r.  /*.i-  -PCT.  (3.13) 

Oi»r0rr,  p2mcPcr.  (3.14) 

Using  (3.I2)-(3.I4),  (3.4)  and  (3.5)  yield  (2.8)  and  (2.9).  Also,  the 
right-hand  sides  of  (3.8)  and  (3.7)  yield  (2.7).  Substituting  (2.7)-(2.9) 
into  (3.6M3.8),  (3.10)  and  (3.11).  it  can  be  seen  that  (3.8)  and  (3.11)  are 
also  superfluous.  Finally,  linear  combinations  of  the  remaining  three 
equations  (3.6),  (3.7),  and  (3. 10)  yield  (2. 10)-(2. 12). 


IV.  Concluding  Remarks 

The  question  of  multiple  local  minima  satisfying  the  optimal  projection 
equations  for  reduced-order  state  estimation  and  the  problem  of  construct¬ 
ing  numerical  methods  for  solving  these  equations  are  beyond  the  scope  of 
this  note.  It  should  be  pointed  out,  however,  that  promising  numerical 
results  for  the  model-reduction  and  fixed-order  dynamic-compensation 
problems  have  been  obtained  by  means  of  iterative  algorithms  that  take 
ftill  advantage  of  the  presence  and  structure  of  the  optimal  projection  (2], 
Hi.  m. 

Finally,  the  results  of  this  paper  can  be  extended  to  include  the 
following  related  problems:  1)  discrete-time  system/discrete-time  estima¬ 
tor;  2)  infinite-dimensional  system/finite-dimensional  estimator  (5);  and 
3)  parameter  uncertainties  [1],  (15],  [16]. 
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The  Optimal  Projection  Equations  for  Fixed-Order 
Dynamic  Compensation 

DAVID  C.  HYLAND  and  DENNIS  S.  BERNSTEIN 

Abstract — First-order  necessary  conditions  for  quadratically  optimal, 
steady-state,  fixed-order  dynamic  compensation  of  a  linear,  time-invari¬ 
ant  plant  in  the  presence  of  disturbance  and  observation  noise  are  derived 
in  a  new  and  highly  simplified  form.  In  contrast  to  the  pair  of  matrix 
Rkcati  equations  for  the  full-order  LQG  case,  the  optimal  steady-state 
fixed-order  dynamic  compensator  is  characterized  by  four  matrix  equa¬ 
tions  (two  modified  Riccati  equations  and  two  modified  Lyapunov 
equations)  coupled  by  a  projection  whose  rank  is  precisely  equal  to  the 
order  of  the  compensator  and  which  determines  the  optimal  compensator 
gains.  The  coupling  represents  a  graphic  portrayal  of  the  demise  of  the 
classical  separation  principle  for  the  reduced-order  controller  case. 

I.  INTRODUCTION 

Because  of  constraints  imposed  by  on-line  computations,  dynamic 
controllers  for  high-order  systems  such  as  flexible  spacecraft  must  be  of 
relatively  modest  order.  Hence,  this  paper  is  concerned  with  the  design  of 
quadratically  optimal,  fixed-order  (i.e.,  reduced-order)  dynamic  compen¬ 
sation  for  a  plant  subject  to  stochastic  disturbances  and  nonsingular 
measurement  noise.  Since  white  noise  in  all  measurement  channels 
precludes  direct  output  feedback  (see  Section  II),  only  purely  dynamic 
controllers  are  considered.  The  requirements  for  resolution  of  this 
optimization  problem  include  the  following. 

1)  Conditions  for  the  existence  of  an  optimal,  stabilizing  compensator 
of  the  prescribed  order.  (In  the  full-order  case  these  are  the  usual 
siabilizability  and  detectability  conditions  of  LQG  theory.) 

2)  Stationary  conditions,  i.e..  first-order  necessary  conditions,  ren¬ 
dered  in  a  tractable  form  to  facilitate  developments  in  items  3)  and  4) 
below .  (In  the  full-order  case  these  conditions  are  precisely  the  LQG  gain 
relations  together  with  the  regulator  and  observer  Riccati  equations.) 

3)  Sufficiency  conditions,  i.e..  additional  restrictions  on  solutions  of 
the  first-order  necessary  conditions  which  characterize  local  minima  and 
single  out  the  global  minimum.  (In  the  full-order  case  the  global 
minimum  is  distinguished  by  the  unique  nonnegative-definite  solutions  to 
the  LQG  Riccati  equations.) 

4)  Convergent  numerical  algorithms  for  simultaneous  satisfaction  of 
the  necessary  and  sufficient  conditions.  (In  the  full-order  case  numerical 
algorithms  have  been  devised  which  take  full  advantage  of  the  highly 
structured  form  of  the  Riccati  equations.) 
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The  present  paper  deals  exclusively  with  item  2).  Although  the 
stationary  conditions  for  (he  fixed-order  compensation  problem  have  been 
written  down  (see  |l|-|12|.  for  example),  full  exploitation  has  undoubt¬ 
edly  been  impeded  by  their  extreme  complexity  |sec  (3.3)-(3.  II)).  What 
has  been  lacking,  to  quote  the  insightful  remarks  of  |9),  “is  a  deeper 
understanding  of  the  structural  coherence  of  these  equations."  The 
contribution  of  the  present  paper  is  to  show  how  the  originally  very 
complex  stationary  conditions  can  be  transformed  without  loss  of 
generality  to  much  simpler  and  more  tractable  forms.  The  resulting 
equations  (2. 10)-(2. 17)  preserve  the  simple  form  of  LQG  relations  for  the 
gains  in  terms  of  covariance  and  cost  matrices  which,  in  turn,  are 
determined  by  a  coupled  system  of  two  modified  Riccati  equations  and 
two  modified  Lyapunov  equations.  This  coupling,  by  means  of  a 
projection  (idempotent  matrix)  whose  rank  is  pecisely  equal  to  the  order 
of  the  compensator,  represents  a  graphic  portrayal  of  the  demise  of  the 
classical  separation  principle  for  the  reduced-order  controller  case.  When, 
as  a  special  case,  the  order  of  the  compensator  is  required  to  be  equal  to 
the  order  of  the  plant,  the  modified  Riccati  equations  reduce  to  the 
standard  LQG  Riccati  equations  and  the  modified  Lyapunov  equations 
express  the  proviso  that  the  compensator  be  minimal,  i.e.,  controllable 
and  observable.  Since  the  LQG  Riccati  equations  as  such  are  nothing 
more  than  the  necessary  conditions  for  fiill-order  compensation,  we 
believe  that  the  "optimal  projection  equations"  provide  a  clear  and  simple 
generalization  of  standard  LQG  theory. 

Since  we  are  concerned  with  optimal  fixed-order  compensator  design, 
our  approach  does  not  represent  yet  another  model-  or  controller- 
reduction  scheme  along  the  lines  of  [13H17].  Indeed,  the  optimal 
projection  equations,  by  virtue  of  their  relatively  transparent  structure, 
can  reveal  the  extent  to  which  the  design  equations  of  a  given  ad  hoc 
reduction  scheme  conform  to  the  necessary  conditions  for  optimality.  For 
example,  the  oblique  projection  which  arises  in  the  present  formulation 
may  not  be  of  the  form  ('  “]  even  in  the  basis  corresponding  to  the 
"balanced"  realization  [  1 3)-[  16].  These  issues  are  discussed  in  (18] 
where  the  results  of  [19]  are  simplified  by  means  of  the  approach  of  the 
present  paper  and  where  the  balancing  method  of  [13]  is  reinterpreted  in 
the  context  of  optimality  theory. 

The  fact  that  the  optimal  projection  equations  consist  of  four  coupled 
matrix  equations,  i.e.,  two  modified  Riccati  equations  and  two  modified 
Lyapunov  equations,  should  not  be  at  all  surprising  for  the  following 
simple  reason.  Reduced-order  control-design  methods  often  involve  either 
LQG  applied  to  a  reduced-order  model  or  model  reduction  applied  to  a 
full-order  LQG  design.  Both  approaches,  then,  involve  the  solution  of 
precisely  four  equations:  two  Riccati  equations  (for  LQG)  plus  two 
Lyapunov  equations  (for  model  reduction  via  balancing,  as  in  (13]).  The 
coupled  form  of  the  optima!  projection  equations  is  thus  a  strong 
reminder  that  the  LQG  and  order-reduction  operations  cannot  be  iterated 
but  must,  in  a  certain  sense,  be  performed  simultaneously. 


U  PROBLEM  STATEMENT  AND  THE  MAIN  THEOREM 


white  observation  noise  with  /  x  /  positive-definite  intensity  k'j,  w,  and 
wj  arc  uncorrelated  and  have  zero  mean.  We  note  that  the  assumptions  of 
nonsingular  control  weighting  and  nonsingular  observation  noise  preclude 
the  use  of  direct  output  feedback  as  in 

u(t)  =  CrXcU)  +  DcyO)  (2.6) 

since  J  is  undefined  unless  (see  (7]) 


tr  [DJRiD,  V j]  =  0  ((=)  R,D ,  V2  =  0).  (2.7) 


To  guarantee  that  J  is  finite  and  independent  of  initial  conditions  we 
restrict  our  attention  to  the  set  of  admissible  stabilizing  compensators 


a  4  ^(Ar,  Bc,  c 

■,).  A  £  [  *  BCr 

B,C  Ac  _ 

is  asymptotically  stable 


} 


where  A  is  the  closed-loop  dynamics  matrix.  Since  the  value  of  J  is 
independent  of  the  internal  realization  of  the  compensator,  we  can  further 
restrict  our  attention  to 


a.  £  {(Ae,  bc ,  cc)  e  a. 


(Ac,  B,)  is  controllable  and  (Cc,  Ac)  is  observable}. 

For  the  following  lemma  call  a  square  matrix  nonnegative  (respectively, 
positive)  semisimple  if  it  has  a  diagonal  Jordan  form  and  nonnegative 
(respectively,  positive)  eigenvalues.  Let  I,  denote  the  r  x  r  identity 
matrix. 

Lemma  2.1:  Suppose  Q,  P  £  J)"**  are  nonnegative  definite.  Then 
QPis  nonnegative  semisimple.  Furthermore,  if  rank  QP  =  nc  then  there 
exist  G,  T  G  mv*"  and  positive-semisimple  Af  €  E'c*"?  such  that 

QP=GtMT,  (2.8) 

TGr=I,c.  (2.9) 

Proof.  The  result  is  an  immediate  consequence  of  [20,  Theorem 
6.2.5,  p.  123].  □ 

For  convenience  in  stating  the  Main  Theorem,  define 

l  ±BR;'BT,  2  4crkY‘C 

and  call  G,  Af,  and  T  satisfying  (2.8)  and  (2.9)  a  (G,  Af,  r)-factorization 
oiQP. 

Main  Theorem:  Suppose  (Ac,  Bc,  Cc)  G  d,  solves  the  steady-state 
fixed-order  dynamic-compensation  problem.  Then  there  exist  n  x  n 
nonnegative-definite  matrices  Q,  P,  £>,  and  P  such  that  Ac,  Bc,  and  Cc  are 
given  by 

Ac  =  r(A-QZ-lP)GT,  (2.10) 

Bf  =  rQC’'K-',  (2.11) 

Cc=  -R;'BrPGT  (2.12) 


Given  the  control  system 

x{t)  =  Axil)  +  Bu(t)  +  H,(r).  ^2.1) 

y(f)  =  Cx(r)  +  w;(/)  (2.2) 

design  a  fixed-order  dynamic  compensator 

xr(t)  =  Aptr(t)  +  B,.y{t),  (2.3) 

u(t)  -  Cpcft)  (2.4) 

which  minimizes  the  steady-suite  performance  criterion 

AA,.  Bc,  C)  £  lim  £IAt)rR,At)  +  u(t)rR:u('n  (2.5) 

r  —  m 


where:  x  €  It",  u  €  if",  y  €  if,  xr  £  «"<•,  nr  ^  n,A,B,  C,  Ar,  Bc, 
Cr,  /?[,  and  /?;  are  matrices  of  appropriate  dimension  with  R,  (symmetric) 
nonnegative  definite  and  R2  (symmetric)  positive  definite;  w,  is  white 
disturbance  noise  with  n  x  n  nonnegalive-definile  intensity  Vt  and  w2  is 


for  some  (G,  Af,  r)-factorization  of  QP,  and  such  that  with  r  A  G'T  the 


following  conditions  are  satisfied: 

0  =  (A  -  tQ1)Q  +  Q(A  -  tQI) r+  K,  +  tQ1Qvt,  (2.13) 

0  =  (A  -  UPr)  tP+  F\A  -  XPt)  +  /?,  +  r  TPZPr,  (2. 14) 

0  =  t\(A-IP)Q  +  Q(A-'ZP)t+QIQ\,  (2.15) 

0=  \(A  -  Qt)TP+  P(A  -  Qt)  +  PXP)r,  (2.16) 

rank  Q  =  rank  £  =  rank  CP-n,.  (2.17) 

Remark  2.1:  Because  of  (2.9)  then  x  n  matrix  r  which  couples  the 
four  equations  (2  13)— (2. 16)  is  idempotent,  i.e.,  r1  =  r.  In  general  this 


"optimal  projection"  is  an  oblique  projection  (as  opposed  to  an 
orthogonal  projection)  since  it  is  not  necessarily  symmetric.  Note  that 
Sylvester's  inequality  and  (2.9)  imply  that  rank  r  =  nc. 

Remark  2.2:  Using  the  relations  Q  =  rQ  and  P  =  Pr  (see  (3.12)], 
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the  optimal  projection  equations  (2.I3M2.16)  can  be  written  in  the 


equivalent  form 

0  =  AQ+QAt+Vi-QZQ  +  t,Q£QtI.  (2.18) 

0  =AtP+PA+R,-PZP+t\PZPtx,  (2.19) 

0  =  (A  - XP)Q+Q(A  -  IP)7*  QlQ- rx QZQt7.  (2.20) 

0^(A-Q1)7PaP(A-QX)aPXP-t\PXPt1.  (2.21) 

where  rx  A  /„  -  r.  Note  that  in  the  full-order  case  nc  =  n,  r  =  G  =  T 


=  /,  and  thus  (2.18)  and  (2.19)  reduce  to  the  standard  observer  and 
regulator  Riccati  equations  and  (2. 10)— (2. 12)  yield  the  usual  LQG 
expressions.  Furthermore,  it  can  be  shown  that  (2.20),  (2.21),  and  (2.17) 
are  equivalent  to  the  assumption  that  (Ac,  Bc,  Cc)  is  controllable  and 
observable. 

Remark  2.3:  Since  QP  is  nonnegative  semisimple  it  has  a  group 
generalized  inverse  (QP)'  given  by  GTM~T  (see  e  g.,  (21,  p.  124}). 
Hence,  hy  (2.9)  the  optimal  projection  r  is  given  by 

r  =  QP(QP)’.  (2.22) 

Remark  2.4:  The  modified  Riccati  equations  (2.13)  and  (2,14)  are 
similar  to  the  (single)  “extended  algebraic  Riccati  equation"  which  arises 
in  the  static  output  feedback  problem  (see,  e.g.,  [22]). 

Remark  2.5:  Replacing  xe  by  Sxc,  where  S  is  invertible,  yields  the 
“equivalent"  compensator  (SAcS’1,  SBC,  CjS'1).  Since  J(AC,  Bc,  Ce) 
=  J(SAcS  ~  *,  SBC,  CcS  ~ •)  one  would  expect  the  Main  Theorem  to  apply 
also  to  (BA'S  ' SB',  CfS  ~ ').  This  is  indeed  the  case  since  transforma¬ 
tion  of  the  compensator  state  basis  corresponds  to  the  alternative 
factorization  QP  -  (S  TG) 7  (SAYS'1)  (ST).  See  [10]  for  related 
remarks. 

Remark  2.6:  By  introducing  the  quasi-full-state  estimate  J?  6Crr,6 
ii"  so  that  ri  =  Jr  and  xc  =  Ti  €  il"‘,  (2.1)— (2.4)  can  be  written  as 

x^Ax  +  BG'TS  +  W|, 

i  =  rt.A  -  B'C  +  BCc)t$+  t6,(Cx+  w2) 

where  Pc  4  QCrV2 1  and  Cc  4  -  R  -  'BTP  Although  the  implemented 
compensator  has  the  state  xc  6  Ii"<,  it  can  be  viewed  as  a  quasi-full-order 
compensator  whose  geometric  structure  is  entirely  dictated  by  the 
projection  r.  Sensor  inputs  B^y  are  annihilated  unless  they  are  contained 
in  |SJllT)]  =  <R(t7),  where  91  and  <R  denote  null  space  and  range. 
Furthermore,  the  quasi-full-order  state  estimate  rjf  employed  in  the 
control  input  is  contained  in  <R(r).  Thus,  <R(r)  and  (R(rr)  are  the  control 
and  observation  subspaces  of  the  compensator. 

III.  PROOF  OF  THE  MAIN  THEOREM 

The  proof  given  here  considerably  simplifies  the  original  derivation 
given  in  [23]  and  [24],  Using  the  fact  that  Q.  is  open,  the  Fritz  John 
version  of  the  Lagrange  multiplier  theorem  can  be  used  to  rigorously 
derive  the  first-order  necessary  conditions  ([7],  see  also  [25]) 


o =AQ+Qat+  i? 

(3.1) 

o=a7P+Pa  +  P, 

(3.2) 

0  =  P[2Q,:  +  P2Q:. 

(3.3) 

Bc=  ~(P-'P] \Q^Q\2)CtV-', 

(3.4) 

C,  =  -R:'B7(P,Q,2Q:'  +  P,,), 

(3.5) 

where 


F,  0  ] 

p  4  r*1  ° 

0  B  v2bJ  J 

■  _  0  CJR2C' 

and  (n  +  nr)  x  (n  +  nr)  P  are  partitioned  into  n  x  n,  n  x  nr,  and 
nr  x  nc  subblocks  as 


r  e,  Go] 

II 

— 1 

> 

L  Q'n  Q  \  ' 

lp:.  P  J 

Expanding  (3.1)  and  (3.2)  yields 

0  =  AQ,  +  QlAr+BCrQ[}  +  Qll(BC')T+  V{,  (3.6) 

0  =  ^e,j+  QI2A7+  BC,Qi  +  Q,(B,C)7,  (3.7) 

0  =  A,®-*  Q2A  7  +  B'CQu  +  Q]2(BrC)T ■¥ B< V2 B7,  (3.8) 

0  =  ATP,  +  PlA  +  (B'C)  TPTn  +  PnB'C  +  /?,,  (3.9) 

0  =  Pi2Ac+ A7Pt ,  +  (B'C)  7P2  +  P\BC',  (3 .  ;0) 

0  =  A  JP2  +  P2Ar  +  (BCt)  rP,2  +  PrnBCt  +  C7R2Cc.  (3.  j  j) 

Writing  (3.8)  as  (see  [26],  [27]) 

0  =  (At  +  B'CQl2Ql )Q2  +  Q,(Ar  +  B,CQr, Q2  )7+Bc V2B7 


where  Q2  is  the  Moore-Penrose  or  Dra2in  generalized  inverse  of  Q2,  it 
follows  from  [28,  Lemmas  2.1  and  12.2]  that  Q:  is  positive  definite. 
Similarly,  (3.11)  implies  that  P2  is  positive  definite.  This  justifies  (3.4) 
and  (3.5). 

Now  define  the  n  x  n  ponnegativc-definite  matrices  (see  [26],  [27]) 

Q  4  Q,-Q„Q;'Q7V  p  4  P>-P>2P;'P72, 

0  4  Qr.Qi'Qli.  PkPnP2'P{2 

and  note  that  (3.3)  implies  (2.8)  and  (2.9)  with 

G  4  Q-2'Q72,  A f  4  Q2P2,  ri-  P2'PI 

Since  QjP2  *  p -  \n^pu2Q2pw2^pui ^  ^  js  semisimple. 

Sylvester’s  inequality  yields  (2.17).  Note  also  that 

Q  =  rQ,P  =  Pr.  (3.12) 

Next  (2.11)  and  (2.12)  follow  from  (3.4)  and  (3.5)  by  using  the 
identities 

Qi  =  Q+Q.  P,~P+P,  (3.13) 

0.:  =  (?rr,  P,2=  -PC7,  (3.14) 

&  =  r$rT,  p2~gPg7.  (3.i5) 

Now  substitute  (2. 11),  (2. 12),  and  (3. 13)-(3. 15)  into  (3.6)-(3. 1 1)  and  use 
the  relations 

B'C=VQ1,  BCc=  -XPG7, 

BcV2B7=TQlQTT,  C7R2C,  =  GPZPGT. 

Then  (2.10)  follows  from  (3.8)-r(3.7).  Substituting  (2.10)  into  (3.7), 
(3.8),  (3.10),  and  (3.11)  shows  that  ((3.7 )G)r  and  -(3.10)r  are 
precisely  (2. 15)  and  (2  16).  Since  CT(3.S)C  =  (2.15)rand  rr(3.11)r  = 
r(2.16),  (3.8)  and  (3.11)  can  be  omitted.  Finally,  using  (3.12)  it  follows 
that  (2.13)  =  (3.6)  +  (2.15)r  -  (2.15)-(2. 15)r  and  similarly  for 
(2.14).  □ 

IV.  DIRECTIONS  FOR  FURTHER  RESEARCH 

With  regard  to  the  existence  of  a  stabilizing  compensator,  known 
results  (e.g.,  [28]-[34])  can  be  exploited  to  a  great  extent.  A  numerical 
algorithm  for  solving  the  optimal  projection  equations  has  been  developed 
in  [24]  and  [35] .  The  proposed  computational  scheme  is  philosophically 
quite  different  from  gradient  search  algorithms  [2],  [3],  [6],  [7],  [9],  [11], 
[36],  [37]  in  that  it  operates  through  dir  ct  solution  of  the  optimal 
projection  equations  by  iterative  refinement  of  the  optimal  projection. 
Methods  for  eliminating  local  extrema  are  being  investigated  by  applying 
component  cost  analysis  [17],  Generalizations  of  the  optimal  projection 
equations  can  arise  by  considering  the  following  extensions  of  the  fixed- 
order  dynamic-compensation  problem. 

I)  Discrete-Time  System /Discrete-Time  Compensator:  Digital  im¬ 
plementation  can  be  modeled  by  a  discrete-time  compensator  with  control 
of  a  continuous-time  system  facilitated  by  sampling  and  reconstruction 
devices. 
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2)  Cross  Weighting/Correlated  Disturbance  and  Observation 
Noise:  This  extension  is  straigh forward  and  entirely  analogous  to  the 
LQG  case  (sec.  e.g.,  |3.  p.  35IJ). 

3)  Singular  Observation  Noise/Singular  Control  Weighting:  With 
due  attention  to  (2.7),  direct  output  feedback  can  be  used  in  the  singular 
case.  The  nature  of  the  problem  forebodes  all  of  the  difficulties  associated 
with  the  singular  LQG  problem.  Note  that  the  output  feedback  problem 
(22),  [38],  when  viewed  in  this  context,  is  highly  singular. 

4)  Infinite-Dimensional  Systems:  The  optimal  projection  equations 
have  been  extended  in  [39]  and  [40]  to  the  case  in  which  (2.1)  is  a 
distributed  parameter  system,  for  example,  a  partial  or  functional 
differential  equation. 

5)  Decentralized  Fixed-Order  Controller:  The  optimal  projection 
equations  can  be  derived  for  the  case  in  which  the  dynamic  controller  has 
a  fixed  decentralized  structure. 

6)  Parameter  Uncertainties:  The  original  derivation  in  [23]  treated  a 
Stratonovich  state-dependent  noise  model  representing  parameter  uncer¬ 
tainties  in  the  plant.  Further  consideration  of  control-  and  measurement- 
dependent  noise  raises  the  possibility  of  directly  including  the  impact  of 
parameter  uncertainties  in  the  design  of  robust,  implememable  compensa¬ 
tion  for  large-order  systems. 
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THE  OPTIMAL  PROJECTION  EQUATIONS  FOR  FINITE-DIMENSIONAL 
FIXED-ORDER  DYNAMIC  COMPENSATION  OF 
INFINITE-DIMENSIONAL  SYSTEMS* 

DENNIS  S.  BERNSTEINt  and  DAVID  C.  HYLANDt 

Abstract.  One  of  the  major  difficulties  in  designing  implementable  finite-dimensional  controllers  for 
distributed  parameter  systems  is  that  such  systems  are  inherently  infinite  dimensional  while  controller 
dimension  is  severely  constrained  by  on-line  computing  capability.  While  some  approaches  to  this  problem 
initially  seek  a  correspondingly  infinite-dimensional  control  law  whose  finite-dimensional  approximation 
may  be  of  impractically  high  order,  the  usual  engineering  approach  involves  first  approximating  the 
distributed  parameter  system  with  a  high-order  discretized  model  followed  by  design  of  a  relatively  low-order 
dynamic  controller.  Among  the  numerous  approaches  suggested  for  the  latter  step  are  model/controller 
reduction  techniques  used  in  conjunction  with  the  standard  LQC  result.  An  alternative  approach,  developed 
in  [36],  relies  upon  the  discovery  in  [31]  that  the  necessary  conditions  for  optimal  fixed-order  dynamic 
compensation  can  be  transformed  into  a  set  of  equations  possessing  remarkable  structural  coherence.  The 
present  paper  generalizes  this  result  to  apply  directly  to  the  distributed  parameter  system  itself.  In  contrast 
to  the  pair  of  operator  Riccati  equations  for  the  “full-order"  LQO  case,  the  optimal  finite-dimensional 
fixed-order  dynamic  compensator  is  characterized  by  four  operator  equations  (two  modified  Riccati  equations 
and  two  modified  Lyapunov  equations)  coupled  by  an  oblique  projection  whose  rank  is  precisely  equal  to 
the  order  of  the  compensator  and  which  determines  the  optimal  compensator  gains.  This  “optimal  projection" 
it  obtained  by  a  full-rank  factorization  of  the  product  of  the  finite-rank  nonnegative-definite  Hilbert-space 
operators  which  satisfy  the  pair  of  modified  Lyapunov  equations.  The  coupling  represents  a  graphic  portrayal 
of  the  demise  of  the  classical  separation  principle  for  the  finite-dimensional  reduced-order  controller  case. 
The  results  obtained  apply  to  a  semigroup  formulation  in  Hilbert  space  and  thus  are  applicable  to  control 
problems  involving  a  broad  range  of  specific  partial  and  functional  differential  equations. 

Key  words,  optimality  conditions,  finite-dimensional  fixed-order  dynamic  compensator,  infinite¬ 
dimensional  system,  distributed  parameter  system,  semisimple  operator,  oblique  projection.  Drazin  general¬ 
ized  inverse 


1.  Introduction.  One  of  the  major  difficulties  in  designing  active  controllers  for 
distributed  parameter  systems  is  that  such  systems  are  inherently  infinite  dimensional 
while  implementable  controllers  are  necessarily  finite  dimensional  with  controller 
dimension  severely  constrained  by  on-line  computing  capability.  As  pointed  out  by 
Balas  ([1],  see  also  [2]),  control  design  for  distributed  parameter  systems  entails  the 
practical  constraints  of  1)  finitely  many  sensors  and  actuators,  2)  a  finite-dimensional 
controller  and  3)  natural  system  dissipation.  The  validity  of  2)  is  apparent  from  the 
fact  that  processing  and  transmitting  electrical  signals  by  conventional  analog  or  digital 
components  constitutes  finite-dimensional  action.  Although  distributed  parameter 
devices  can  also  be  utilized,  their  fabrication  and  implementation  can  incorporate  at 
most  a  finite  number  of  design  specifications.'  Hence,  although  distributed  parameter 
systems  are  most  accurately  represented  by  infinite-dimensional  models,  real-world 


•  Received  by  the  editors  December  6,  1983,  and  in  revised  form  September  15,  1984.  This  work  was 
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1  Examples  of  such  components  include  tapped  delay  lines  and  surface  acoustic  wave  devices.  Although 
acoustoelectric  convolvers  [3,  p.  465]  can  perform  continuous-time  integration,  synthesis  of  the  desired 
impulse-response  kernel  can  incorporate  only  finitely  many  specified  parameters.  The  obvious  fact  should 
also  be  noted  that  physical  limitations  impose  an  upper  bound  on  the  number  of  design  parameters  that 
can  be  incorporated  in  the  construction  of  any  device.  For  an  extensive  treatment  of  this  subject,  see  [72]. 
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constraints  require  that  implementabie  controllers  be  modelled  as  lumped  parameter 
systems. 

Clearly,  the  above  observations  effectively  preclude  the  possibility  of  realizing 
infinite-dimensional  controllers  that  involve  full-state  feedback  or  full-state  estimation 
(see,  e.g.,  [4]-[6]  and  the  numerous  references  therein).  Although  finite-dimensional 
approximation  schemes  have  been  applied  to  optimal  infinite-dimensional  control  laws 
([7]-[9]),  these  results  only  guarantee  optimality  in  the  limit,  i.e.,  as  the  order  of  the 
approximating  controller  increases  without  bound.  Hence,  there  is  no  guarantee  that 
a  particular  approximate  (i.e.,  discretized)  controller  is  actually  optimal  over  the  class 
of  approximate  controllers  of  a  given  order  dictated  by  implementation  constraints. 
Moreover,  even  if  an  optimal  approximate  finite-dimensional  controller  could  be 
obtained,  it  would  almost  certainly  be  suboptimal  in  the  class  of  all  controllers  of  the 
given  order. 

Although  the  usual  engineering  approach  to  this  problem  is  to  replace  the  dis¬ 
tributed  parameter  system  with  a  high-order  finite-dimensional  model,  analogous, 
fundamental  difficulties  remain  since  application  of  LQG  leads  to  a  controller  whose 
order  is  identical  to  that  of  the  high-order  approximate  model.  Attempts  to  remedy 
this  problem  usually  rely  upon  some  method  of  open-loop  model  reduction  or  closed- 
loop  controller  reduction  (see,  e.g.,  [10]-[15]).  Most  of  these  techniques  (with  the 
exception  of  [11])  are  ad  hoc  in  nature,  however,  and  hence  guarantees  of  optimality 
and  stability  may  be  lacking. 

A  more  direct  approach  that  avoids  both  model  and  controller  reduction  is  to  fix 
the  controller  structure  and  optimize  the  performance  criterion  with  respect  to  the 
controller  parameters.  Although  much  effort  was  devoted  to  this  approach  (see,  e.g., 
[  16]— [30]),  progress  in  this  direction  was  impeded  by  the  extreme  complexity  of  the 
nonlinear  matrix  equations  arising  from  the  first-order  necessary  conditions.  What  was 
lacking,  to  quote  the  insightful  remarks  of  [24],  was  a  “deeper  understanding  of  the 
structural  coherence  of  these  equations."  The  key  to  unlocking  these  unwieldy  equations 
was  subsequently  discovered  by  Hyland  in  [31]  and  developed  in  [32]-[36].  Specifically, 
it  was  found  that  these  equations  harbored  the  definition  of  an  oblique  projection  (i.e., 
idempotent  matrix)  which  is  a  consequence  of  optimality  and  not  the  result  of  an  ad 
hoc  assumption.  By  exploiting  the  presence  of  this  “optimal  projection,"  the  originally 
very  complex  stationary  conditions  can  be  transformed  without  loss  of  generality  into 
much  simpler  and  more  tractable  forms.  The  resulting  equations  (see  [36,  (2.10)-(2.17)]) 
preserve  the  simple  form  of  LQG  relations  for  the  gains  in  terms  of  covariance  and 
cost  matrices  which,  in  turn,  are  determined  by  a  coupled  system  of  two  modified 
Riccati  equations  and  two  modified  Lyapunov  equations.  This  coupling,  by  means  of 
the  optimal  projection,  represents  a  graphic  portrayal  of  the  demise  of  the  classical 
separation  principle  for  the  reduced-order  controller  case.  When,  as  a  special  case, 
the  order  of  the  compensator  is  required  to  be  equal  to  the  order  of  the  plant,  the 
modified  Riccati  equations  immediately  reduce  to  the  standard  LQG  Riccati  equations 
and  the  modified  Lyapunov  equations  express  the  proviso  that  the  compensator  be 
minimal,  i.e.,  controllable  and  observable.  Since  the  LQG  Riccati  equations  as  such 
are  nothing  more  than  the  necessary  conditions  for  full-order  compensation,  the 
“optimal  projection  equations”  appear  to  provide  a  clear  and  simple  generalization 
of  standard  LQG  theory. 

The  fact  that  the  optimal  projection  equations  consist  of  four  coupled  matrix 
equations,  i.e.,  two  modified  Riccati  equations  and  two  modified  Lyapunov  equations, 
can  readily  be  explained  by  the  following  simple  reason.  Reduced-order  control-design 
methods  often  involve  either  LQG  applied  to  a  reduced-order  model  or  model  reduction 
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applied  to  a  full-order  LQG  design,  and  hence  both  approaches  require  the  solution 
of  precisely  four  equations:  two  Riccati  equations  (for  LQG)  plus  two  Lyapunov 
equations  (for  system  reduction  via  balancing,  as  in  [12],  [14]).  The  coupled  form  of 
the  optimal  projection  equations  is  thus  a  strong  reminder  that  the  LQG  and  order- 
reduction  operations  cannot  be  iterated  but  must,  in  a  precise  sense,  be  performed 
simultaneously.  This  situation  is  partly  due  to  the  fact  that  the  optimal  projection  matrix 
may  not  be  of  the  form  [<5  o]  even  in  the  basis  corresponding  to  the  “balanced" 
realization  [12],  [14].  This  point  is  explored  in  [37],  [37a]  where  the  solution  to  the 
optimal  model-reduction  problem  is  characterized  by  a  pair  of  modified  Lyapunov 
equations  which  are  also  coupled  by  an  oblique  projection. 

Returning  now  to  the  distributed  parameter  problem,  it  should  be  mentioned  that 
notable  exceptions  to  the  previously  mentioned  work  on  distributed  parameter  control¬ 
lers  are  the  contributions  of  Johnson  [38]  and  Pearson  [39],  [40]  who  suggest  fixing 
the  order  of  the  finite-dimensional  compensator  while  retaining  the  distributed  para¬ 
meter  model.  Progress  in  this  direction,  however,  was  impeded  not  only  by  the 
intractability  of  the  optimality  conditions  that  were  available  for  the  finite-dimensional 
problem  (as  in  [16]-[30]),  but  also  by  the  lack  of  a  suitable  generalization  of  these 
conditions  to  the  infinite-dimensional  case.  The  purpose  of  the  present  paper  is  to 
make  significant  progress  in  filling  these  gaps,  i.e.,  by  deriving  explicit  optimality 
conditions  which  directly  characterize  the  optimal  finite-dimensional  fixed-order 
dynamic  compensator  for  an  infinite-dimensional  system  and  which  are  exactly 
analogous  to  the  highly  simplified  optimal  projection  equations  obtained  in  [31]-[34], 
[36]  for  the  finite-dimensional  case.  Specifically,  instead  of  a  system  for  four  matrix 
equations  we  obtain  a  system  of  four  operator  equations  whose  solutions  characterize 
the  optimal  finite-dimensional  fixed-order  dynamic  compensator.  Moreover,  the 
optimal  projection  now  becomes  a  bounded  idempotent  Hilbert-space  operator  whose 
rank  is  precisely  equal  to  the  order  of  the  compensator. 

The  mathematical  setting  we  use  is  standard:  a  linear  time-invariant  differential 
system  in  Hilbert  space  with  additive  white  noise,  finitely  many  controls  and  finitely 
many  noisy  measurements  (thus  satisfying  the  first  practical  constraint  mentioned 
above).  The  input  and  output  maps  are  assumed  to  be  bounded.  Since  the  only  explicit 
assumption  on  the  unbounded  dynamics  operator  is  that  it  generate  a  strongly  con¬ 
tinuous  semigroup,  the  results  are  potentially  applicable  to  a  broad  range  of  specific 
partial  and  functional  differential  equations.  The  actual  applicability  of  our  results  is 
essentially  limited  by  practical  constraint  3).  Since  we  are  concerned  with  the  steady- 
state  problem,  we  implicitly  assume  that  the  distributed  parameter  system  is  stabilizable, 
i.e.,  that  there  exists  a  dynamic  compensator  of  a  given  order  such  that  the  closed-loop 
system  is  uniformly  stable.  We  note  that  stabilizing  compensators  do  exist  for  the  wide 
class  of  problems  considered  in  [41]  and  [42]  which  includes  delay,  parabolic  and 
damped  hyperbolic  systems.  The  question  of  how  much  damping  is  required  for 
stabilizability  of  hyperbolic  systems  is  a  crucial  issue  in  designing  controllers  for  large 
flexible  space  structures  [7],  [43J-[49a]. 

It  is  important  to  point  out  that  the  results  of  this  paper  can  immediately  be 
specialized  to  finite-dimensional  systems  by  requiring  that  the  Hilbert  space  characteriz¬ 
ing  the  dynamical  system  be  finite-dimensional.  Then  all  unboundedness  considerations 
can  be  ignored,  adjoints  can  be  interpreted  as  transposes  and  other  obvious  sim¬ 
plifications  can  be  invoked.  The  only  mathematical  aspect  requiring  attention  is  the 
treatment  of  white  noise  which,  for  general  handling  of  the  infinite-dimensional  case, 
is  interpreted  according  to  [6].3  For  the  finite-dimensional  case,  however,  the  standard 
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classical  notions  suffice  and  the  results  go  through  with  virtually  no  modifications. 

The  contents  of  the  paper  are  as  follows.  Section  2  contains  preliminary  notation 
in  addition  to  particular  results  for  use  later  in  the  paper.  Section  3  presents  the  optimal 
steady-state  finite-dimensional  fixed-order  dynamic-compensation  problem  and  the 
Main  Theorem  gives  the  necessary  conditions  in  the  form  of  the  optimal  projection 
equations  (3.15)-(3.18).  We  then  develop  a  series  of  results  which  serve  to  elucidate 
several  aspects  of  the  Main  Theorem.  Section  4  is  devoted  to  the  proof  of  the  Main 
Theorem.  The  reader  is  alerted  to  the  two  crucial  steps  required.  The  first  step  involves 
generalizing  to  the  infinite-dimensional  case  the  derivation  of  the  necessary  conditions 
in  their  “primitive”  form  (see  (4.27)-(4.29)  and  (4.48)-(4.53)).  The  derivation  in 
[31]-[33],  [36]  involving  Lagrange  multipliers  is  invalid  in  the  infinite-dimensional 
case  due  to  the  presence  of  the  unbounded  system-dynamics  operator.  Instead,  we  use 
the  gramian  form  of  the  closed-loop  covariance  operator  to  obtain  a  dual  problem 
formulation  and  then  proceed  to  derive  the  primitive  necessary  conditions  by  means 
of  a  lengthy,  but  direct,  computation  (Lemma  4.7).  The  second  crucial  step  involves 
transforming  the  primitive  form  of  the  necessary  conditions  to  the  final  form  given  in 
the  Main  Theorem.  This  laborious  computation  was  first  carried  out  in  [31],  [32]  and 
was  subsequently  facilitated  in  [33],  [36]  by  means  of  a  judicious  change  of  variables 
(see  (4.32),  (4.33)).  Finally,  some  concluding  remarks  are  given  in  §  5. 

2.  Preliminaries.  In  this  section  we  introduce  general  notation  along  with  basic 
definitions  and  results  for  use  in  later  sections.  Our  principal  references  are  [6],  [50] 
and  [51]. 

Throughout  this  section  let  X,  X"  and  X"  denote  real  separable  Hilbert  spaces 
with  norm  ||  •  ||  and  inner  product  ( - ,  • )  and  let  9S(X,  X)  denote  the  space  of  bounded 
linear  operators  from  X  into  X'.  For  Lb  $&(X,  X),  ||L||  is  the  norm  of  L,  31  (L)  is  the 
range  of  L,  Jf(L)  is  the  null  space  of  L,  p(L)  is  the  rank  of  L  (set  p(L)  =  oo  if  L  does 
not  have  finite  rank),  L~'  is  the  inverse  of  L  when  L  is  invertible,  i.e.,  when  L  has  a 
bounded  inverse,  L*  is  the  adjoint  of  L  and  L~*&(L*)~'.  Recall  that  ||L||  =  ||I*||  and 
that  p(L )  =  p(L*)  [50,  p.  161].  Now  suppose  that  X  «  X  so  that  Le  96(X)&  9&(X,  X). 
If  IX* -L*L  then  L  is  normal  and  if  L-L *  then  L  is  selfadjoint.  If  L  is  selfadjoint 
and  (Lx,  x)g0,  xeX,  then  L  is  non  negative  definite.  Note  that  the  selfadjointness 
assumption  is  included  in  the  definitio  since  the  Hilbert  spaces  are  assumed  real.  If 
L  is  nonnegative  definite  then  Ll/Z  denotes  the  (unique)  nonnegative-definite  square 
root  of  L.  Call  L  semisimple  (resp.,  real  semisimple,  nonnegative  semisimple)  if  there 
exists  invertible  SbSB(X)  such  that  SLS~l  is  normal  (resp.,  selfadjoint,  nonnegative 
definite).  This  implies  that  SLS~ '  has  a  complete  set  of  orthonormal  eigenvectors  and, 
in  the  real-semisimple  or  nonnegative-semisimple  cases,  has  real  or  nonnegative  eigen¬ 
values. 

Recall  that  if  Lb9H(X)  is  compact  then  L  has  at  most  a  countable  number  of 
eigenvalues  and  all' nonzero  eigenvalues  have  finite  multiplicity.  Hence,  for  Lb 
9)(X,X)  compact,  let  {o,}  be  the  (at  most  countable)  sequence  of  eigenvalues  of 
( LL*)in  with  appropriate  multiplicity  and  a,£a2£-''>0  [50,  p.  261].  Then 
&i(X,  X")  denotes  the  set  of  trace  class  (or  nuclear)  operators,  i.e.,  the  set  of  compact 


2  Alternatively,  we  could  have  adopted  the  white  noise  formulation  of  (4).  The  main  difference  between 
the  two  white  noise  formalisms  is  that  Balakrishnan  works  with  finitely  additive  rather  than  countably 
additive  measures.  Strictly  speaking,  then,  even  in  finite  dimensions  Balakrishnan’s  white  noise  is  different 
from  the  standard  notion  (see  [6,  pp.  307,  313)). 
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Le  £(X,  X)  for  which  »i<®  [50,  p.  521],  36t(X,  X)  is  a  Banach  space  with  norm 

!|i-!l.AX«, 

i 

If  then  Le  3B2(X,  X),  the  set  of  Hilbert-Schmidt  operators,  which  is  a 

Banach  space  with  norm 

IU-!UA[x«?]'/J. 

Note  that  ||L||S||L||2S||L||„  ||L||  =  ||L*||,  |L|,-|L*I,  and  ||L||2  =  ||L*||2.  If 
then  we  write  SB, (3(f)  and  SB2(af)  for  &,(%,  X)  and  X),  respectively.  Note  that 
if  nonnegative-definite  Le  36 t(X)  then  LU2e  362(X). 

If  Le98,(X,  X')  and  S e  36(X,  X")  then 

lISLli.SlISIIIlLH, 

and  hence  SLe  36  fX,  X').  Similarly,  under  suitable  hypotheses, 

IILSII.SIISIIIILII,, 

and 

|5L|,S|5|,|L|,. 

Lemma  2.1.  Suppose  Le  3>t(X)  and  let  {A,}  denote  the  nonzero  eigenvalues  of  L 
with  appropriate  multiplicity.  Then  [51,  p.  89] 

E|a,|s||l||,. 

i 

If  Lis  selfadjoint  then  [50,  p.  522] 

XlA.Mlill,. 

I 

If  L  is  nonnegative  definite  then 

IAi-|L|,. 

i 

Let  Le 3>,(X).  Then  define  [50,  p.  523]  the  trace  functional  tr:  36,(X)-*R  by 

tr  L±Z{14>„ 

i 

where  the  summation  is  independent  of  the  choice  of  orthonormal  basis  {<&}.  The  trace 
satisfies  tr  L  =  tr  I*,  tr  SL  =  tr  LS  for  all  S  e  36 ( X),  tr  ST  =  tr  TS  for  all  S,  T e  ®2(X) 
and  tr(«T+/3S)  =  a(tr  T)  +  /3(trS)  for  all  «,  0eR  and  S,  Te  36 fX). 

Lemma  2.2.  Suppose  Le  36t(X)  and  let  {A*}  denote  the  nonzero  eigenvalues  of  L 
with  appropriate  multiplicity.  Then  [51,  p.  139] 

trL  =  £  A, 

i 

and  hence  (by  Lemma  2.1) 

|trL|s||L||„ 


If  L  is  nonnegative  definite  then 


trL-IILH,. 
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Corollary  2.1.  For  each  S  e  96  (3€)  the  linear  functionals 

L-HtSL:  R, 

L-*U  LS:  3B,(5if)-»R 

are  continuous.  For  each  Le  96  ,(2if)  the  linear  functionals 

S-rtrLS:  9t(3 (f) -* R, 

5  -» tr  SL:  »(**)-*  R 

are  continuous. 

Although  showing  that  a  bounded  linear  operator  is  trace  class  is  slightly  more 
involved  than  the  above  characterizations  of  &,(2if),  the  following  result  will  suffice 
for  our  purposes  (see  [52,  p.  96],  or  [52a,  p.  171]). 

Lemma  2.3.  Let  Le31(9€)  be  nonnegative  definite.  Then 

I  (L4>h  4><), 

t 

whether  finite  or  infinite,  is  independent  of  the  orthonormal  basis  {<£,}.  The  summation  is 
finite  if  and  only  if  Le  38,(ISf). 

Many  of  the  operators  introduced  in  the  following  section  have  finite-dimensional 
domain  or  range  space  and  hence  are  degenerate,  i.e.,  have  finite  rank.  Recall  that 
degenerate  operators  are  necessarily  trace  class.  The  following  result,  which  generalizes 
[53,Thm.  2.1,  p.  240]  in  certain  respects,  will  be  fundamental  in  decomposing  finite-rank 
operators. 

Lemma  2.4.  Suppose  L,,  •  •  • ,  LreB( X,  3t)  have  finite  rank.  Then  there  exists  a 
finite-dimensional  subspace  At  <=X  such  that  LJlx-  0,  i  =  1,  •  •  • ,  r.  Furthermore,  if 
X  =  X  then  At  can  be  chosen  such  that  L*M  c  At,  i-l,-  ■  •  ,r. 

Proof.  It  suffices  to  consider  the  case  r- 1.  Writing  L  for  L,,  note  that  since 
p(L*)< oo,  X(L)x  =  9t(L*)  [50,  p.  155]  and  Jf(L)  is  closed,  the  first  statement  holds 
with  At  =  Af(L)x.  When  X=X'  set  At  =  Jf(L)x  +  &(L)  and  note  that  Alx  = 
Jf(L)C[9t(L)x  <=■  Jf(L)  and  LAt  c  9l(L)<=  At.  □ 

The  following  generalization  of  Sylvester’s  inequality  [54,  p.  66]  will  be  used 
repeatedly  in  handling  finite-rank  operators. 

Lemma  2.5.  Let  5T)  and  Se&W,  ST).  Then 

(2.1)  p(SL)  S  min  (p(S),  p(L)}. 

If  dim  W  =  v  <  oo,  then 

(2.2)  p(S)  +  p(L)~  uSp(SL). 

Proof.  If  either  S  or  L  does  not  have  finite  rank  then  (2.1)  is  immediate.  If  both 
S  and  L  have  finite  rank  then  the  standard  arguments  [54]  used  to  prove  the  finite¬ 
dimensional  version  of  (2.1)  remain  valid.  To  prove  (2.2),  note  that  Lemma  2.4  implies 
that  there  exist  orthonormal  bases  for  3€  and  2C  with  respect  to  which  L  has  the  matrix 
representation  [L  0],  where  LeR*"''’.  Similarly,  there  exist  orthonormal  bases  for  3T 
and  ST  with  respect  to  which  S  has  the  matrix  representation  [f],  where  SeR"**. 
Since  the  two  cited  bases  for  ST  may  be  different,  let  orthogonal  U  e  R  be  the  matrix 
representation  (with  respect  to  either  basis  for  9T)  for  the  change  in  orthonormal  basis 
[6,  p.  100].  Hence  SL  has  the  matrix  representation  [S%L  S]  and  (2.2)  follows  from 
the  known  result  [54,  p.  66].  0 

As  in  the  proof  of  Lemma  2.5,  we  shall  utilize  the  infinite-matrix  representation 
of  an  operator  with  respect  to  an  orthonormal  basis.  All  matrix  representations  given 
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here  will  consist  of  real  entries  since  the  Hilbert  spaces  involved  are  real.  When  the 
orthonormal  bases  are  specified  and  no  confusion  can  arise,  we  shall  not  differentiate 
between  an  operator  and  its  matrix  representation.  We  shall  use  the  infinite  identity 
matrix  /«,  interchangeably  with  the  identity  /*  on 

When  dealing  with  finite-dimensional  Euclidean  spaces  the  notation  and  ter¬ 
minology  introduced  above  will  be  utilized  with  only  minor  changes.  For  example, 
bounded  linear  operators  will  be  represented  by  matrices  whose  elements  are  deter¬ 
mined  according  to  fixed  orthonormal  bases  and  hence  we  identify  RmX"  =  98(R",  Rm). 
Note  that  if  LeSB(R",  31?)  and  SeSS(S€,  Rm)  then  SL  is  an  mxn  matrix  which  is 
independent  of  any  particular  orthonormal  basis  for  3lf.  The  transposes  of  x  e  R"  A  r"  xl 
and  M  eR1"*"  are  denoted  by  xT  and  MT  and  \i~T  &(MT)~l.  Let  /„  denote  the  n  x  n 
identity  matrix. 

To  specialize  some  of  the  above  operator  terminology  to  matrices,  let  MeR"x". 
We  shall  say  M  is  nonnegative  (resp.,  positive)  diagonal  if  M  is  diagonal  with 
nonnegative  (resp.,  positive)  diagonal  elements.  M  is  nonnegative  (resp.,  positive) 
definite  if  M  is  symmetric  and  xTMx£0  (resp.,  xTMx> 0),  xeR".  Recall  that  M  is 
symmetric  (resp.,  nonnegative  definite,  positive  definite)  if  and  only  if  there  exists 
orthogonal  Ue  R"xn  such  that  UMUr  is  diagonal  (resp.,  nonnegative  diagonal,  positive 
diagonal).  Af-is  semisimple  [55,  p.  13],  or  nondefective  [56,  p.  375],  if  M  has  n  linearly 
independent  eigenvectors,  i.e.,  M  has  a  diagonal  Jordan  canonical  form  over  the 
complex  field.  M  is  real  (resp.,  nonnegative,  positive)  semisimple  if  M  is  semisimple 
with  real  (resp.,  nonnegative,  positive)  eigenvalues.  Note  that  M  is  real  (resp.,  nonnega¬ 
tive,  positive)  semisimple  if  and  only  if  there  exists  invertible  Se  Rnx"  such  that  SMS~' 
is  diagonal  (resp.,  nonnegative  diagonal,  positive  diagonal).  Alternatively,  M  is  real 
(resp.,  nonnegative,  positive)  semisimple  if  and  only  if  there  exists  invertible  SeRnXB 
such  that  SMS~'  is  symmetric  (resp.,  nonnegative  definite,  positive  definite). 

Lemma  2.6.  The  product  of  two  nonnegative -  (resp.,  positive-)  definite  matrices  is 
nonnegative  (resp.,  positive)  semisimple. 

Proof.  If  5,  LeR"x"  are  both  nonnegative  (resp.,  positive)  definite  then  by  [55, 
Thm.  6.2.5,  p.  123]  there  exists  invertible  <^eR"x"  such  that  Ds& and 
DL&4>TLd>  are  nonnegative  (resp.,  positive)  diagonal.  Hence,  SL  =  <t>DsDL<t>~'  is 
nonnegative  (resp.,  positive)  semisimple,  as  desired.  Alternatively,  if  either  S  or  L  is 
positive  definite,  then  the  result  follows  from  SL=  L~'n(L'nSL'n)V2  if  L  is  positive 
definite  or  SL  =  SU2(S'/2LSl/2)S~'n  if  S  is  positive  definite.  □ 

3.  Problem  statement  and  the  Main  Theorem.  We  consider  the  following  steady- 
state  fixed-order  dynamic-compensation  problem.  Given  the  dynamical  system  on 
[0,oo) 

(3.1)  x(f)  =  Ax(t)+  Bu(t)+  Htw(t), 

(3.2)  y(t)  =  Cx(t)  +  H2w(t), 

design  a  finite-dimensional  fixed-order  dynamic  compensator 

(3.3)  Jtc(r)  ■  Acxc(t)+  Bcy(t), 

(3.4)  «(<)  =  Ccxc(t) 

which  minimizes  the  steady-state  performance  criterion 

(3.5)  J(A„  B„  Cc)  A  lim  E[(R,x(»),  x(t)>+  u(t)TR2u(0). 

QO 
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The  following  data  are  assumed.  The  state  x(/)  is  an  element  of  a  real  separable 
Hilbert  space  SC  and  the  state  differential  equation  is  interpreted  in  the  weak  sense 
(see,  e.g.,  [6,  pp.  229,  317]).  The  closed,  densely  defined  operator  A:  2(A)  c  SC-*  SC 
generates  a  strongly  continuous  semigroup  eA\  rfe 0.  The  control  u(t)e Rm,  Be 
®(R",  SC)  and  the  operator  /?,€&, (3f)  and  the  matrix  R2eR"”<m  are  nonnegative 
definite  and  positive  definite,  respectively.  w(  • )  is  a  zero-mean  Gaussian  “standard 
white  noise  process”  in  L2((0,  oo),  SC)  (see  [6,  p.  314]),  where  St"  is  a  real  separable 
Hilbert  space,  H,  e  SB2(SC',  SC),  H2  e  SB  (SC,  R1)  and  “E”  denotes  expectation.  We  assume 
that  HXH%  =  0,  i.e.,  the  disturbance  and  measurement  noises  are  independent,*'  and 
that  Vj&HiHfeR1  is  positive  definite,  i.e.,  all  measurements  are  noisy.  Note  that 
V,  A  H,H?  e  SB, (SC)  is  nonnegative  definite  and  trace  class.4  The  initial  state  x(0)  is 
Gaussian  and  independent  of  *»•(■).  The  observation  y(()eR*  and  Ce  SB(SC,R').  The 
dimension  of  the  compensator  state  xc(()  is  of  fixed,  finite  order  nc£dim  SC  and  the 
optimization  is  performed  over  Ac  e  R Bce  R"'*'  and  Ce  e 

To_handle  the  closed-loop  system  (3.1 )— (3.4),  we  introduce  the  augmented  state 
space  SC& Sf©R"'  which  is  a  real  separable  Hilbert  space  with  inner  product  (x,,  x2>  A 
<x„x2)+xcr,xc2,  x, A (Xi, xci).  An  operator  LeSB(SC)  has  a  “decomposition"  into 
operators  L,eSB(SC),  Ll2e  SB( R\  SC),  9B(^f, R"')  and  L2eR"'x"'  in  the  sense  that 
for  x  A  (x,  xc)  €  SC,  Lx  =  (L,x  +  L12xn  L^x  +  L^Xc),  or,  in  “block"  form. 


For  later  use  note  that 


||L||S||L1||-t-||LI2||  +  ||JL21||  +  |(L22|| 


and 


,  r^r  l?,] 

Ur*  lij- 


We  can  similarly  construct  unbounded  operators  in  SC.  Hence,  define  the  closed- 
loop  dynamics  operator  A:  3>(A)<=.SC-*$C  on  the  dense  domain  9>(A)  A  2(A)  xR" 
by  Ax  =  (Ax  +  BC^  BcCx  +  AjXc).  Since  A  can  be  represented  by 

-  T  A  BC/|  =[A  0]  T  0  BC/1 

L flcC  aJ  Lo  oj  LBfC  AcJ 


and  since  the  closed-loop  operator 

i  nl  . 

:®(A)-Sf 

generates  the  strongly  continuous  semigroup 

(SO, 


[:  a- 


’eA'  0  1 

.  0  /J’ 


it  follows  from  (50,  Thm.,  p.  497]  that  A  is  also  closed  and  generates  a  strongly 
continuous  semigroup  e e  SB(SC),  t  S  0.  To  guarantee  that  J  is  finite  and  independent 


1  This  assumption  and  it*  analogue,  the  lack  of  a  cross-weighting  term  *(r)TR12u(f)  in  (3.5),  are  for 
convenience  only.  See  I  5. 

4  We  must  require  that  R,  and  V,  be  nuclear  since  covariance  operators  in  the  white  noise  formulation 
of  [6]  are  not  necessarily  trace  class  as  they  are  in  the  formulation  of  (4). 
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of  initial  conditions  we  restrict  our  attention  to  the  set  of  admissible  stabilizing 
compensators 

si  Ba  Cf):  e*'  is  exponentially  stable}. 

Hence  if  (A„  Ba  Cc)€si  then  there  exist  a  >  0  and  >  0  such  that 

(3.6)  He'*'!!  S.  a  e~p',  t  S  0. 

Since  the  value  of  J  is  independent  of  the  internal  realization  of  the  compensator,  we 
can  further  restrict  our  attention  to 

si+&{(An  Bn  Cc)esi:  (A„  Bc)  is  controllable  and  (CnAc)  is  observable}. 

The  following  lemma  is  required  for  the  statement  of  the  Main  Theorem. 
Lemma  3.1.  Suppose  Q,  Pe  38  (X)  have  finite  rank  and  are  nonnegative  definite. 
Then  QP  is  nonnegative  semisimple.  Furthermore,  if  p(QP)  =  nc  then  there  exist  G, 
T  e  98(3?,  R"<)  and  positive-semisimple  Me  R*  such  that 

(3.7)  QP  =  G*MT, 


(3.8) 


TG*=  I. 


Proof.  By  Lemma  2.4  there  exists  a  finite-dimensional  subspace  M  <=■  X  such  that 
QMcM,  QM±  =  0,  PMc-M  and  PM±  =  0.  Hence  there  exists  an  orthonormal  basis 
for  X  with  respect  to  which  Q  and  P  have  the  infinite-matrix  representations 


'-[5  9 


where  <?,,  P,  e  R'*'  are  nonnegative  definite  and  r  A  dim  M.  Since  by  Lemma  2.6  there 
exists  invertible  such  that  is  nonnegative  diagonal,  we  have 


[v  oirA  oiiM'-  oi 
Q  Lo  /J[o  oJL  o  /J’ 


which  shows  that  QP  is  nonnegative  semisimple.  If,  furthermore,  p(QP)  =  nc  then  it 
is  clear  that  'P  can  be  chosen  (i.e.,  modified  by  an  orthogonal  matrix)  so  that 


JA  O' 

‘  Lo  OJ’ 


where  AeR"'*"  is  positive  diagonal.  Hence, 


•Ho  l\P)W  °tT  £]• 


'L  o  J 


which  shows  that  (3.7)  and  (3.8)  are  satisfied  with 

G-[[S'  0)  of;  °],  M.S-AXr-ttS-  o]  of;  ;]. 
for  all  invertible  S  e  R"*x"r.  0 

We  shall  refer  to  G,  Te  38(X,  R"‘)  and  positive-semisimple  Me  R  satisfying 

(3.7)  and  (3.8)  as  a  (G,  M,  T ) -factorization  of  QP.  For  convenience  in  stating  the  Main 
Theorem  define 

I  abrj'b*,  IAc*VJ'C. 
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Main  Theorem.  Suppose  (Ac,B„Ce)est+  solves  the  steady-state  fixed-order 
dynamic-compensation  problem.  Then  there  exist  nonnegative-definite  Q,  P,Q,Pe  3B,(!P) 
such  that  An  Bc  and  Cc  are  given  by 

(3.9)  Ac  =  r(A-<?i-2P)G*, 

(3.10)  Bc  =  roc*vj', 

(3.11)  Cc  =  -BJ'B*PG*, 

for  some  (G,  M,D-factorization  of  QP,  and  such  that,  with  T^G’r,  the  following 
conditions  are  satisfied : 

(3.12a, b)  Q-.  2>(A*)-S(A),  P:  2(A)- 2C(A*), 

(3.13a,  b)  Q.X-*2>(A),  P:X-+2(A*), 

(3.14a,  b,c)5  p«?)=p(P)=p«?P)  =  n„ 

(3.15)  Q~(A-tQ1)Q+Q(A~tQ1)*+  V,  +  tQIQt*, 

(3.16)  0  =  (A  —  2Pr)*P  +  P(A  —  I,Pr)  +  Rt  +  t*  P2.Pt, 

(3.17)  0=[(A-2.P)Q+O(A-IP)*  +  <?SQ]r*, 

(3.18)  0  =  [(A-Q£)*P+P(A-Qi)  +  PIP]r. 

The  content  of  the  Main  Theorem  is  clearly  a  set  of  necessary  conditions  which 
characterize  the  optimal  steady-state  fixed-order  dynamic  compensator  when  it  exists. 
These  necessary  conditions  consist  of  a  system  of  four  operator  equations  including 
a  pair  of  modified  Riccati  equations  (3.15)  and  (3.16)  and  a  pair  of  modified  Lyapunov 
equations  (3.17)  and  (3.18).  The  salient  feature  of  these  four  equations  is  the  coupling 
by  the  operator  r  e  SB  (3(f)  which,  because  of  (3.8),  is  idempotent,  i.e.,  t2  =  r.  In  general, 
r  is  an  oblique  projection  and  not  an  orthogonal  projection  since  there  is  no  requirement 
that  r  be  selfadjoint.  Additional  features  of  the  Main  Theorem  will  be  discussed  in 
the  remainder  of  this  section.  For  convenience,  let  G,  M,  T,  r,  Q,  P,  Q  and  P  be  as 
given  by  the  Main  Theorem  and  define  A  A  diag  (A  ,,•••,  A„( ),  where  A ,  g  Az  S  •  •  •  g 
A„t  >  0  are  the  eigenvalues  of  M. 

We  begin  by  noting  that  if  xc  is  replaced  by  Sxn  where  SeR"  *"  is  invertible, 
then  an  "equivalent”  compensator  is  obtained  with  (A„  B„  Cc)  replaced  by 
(SAcS-',SB0CcS-'). 

Proposition  3.1.  Let  (A„  BnCc)c  sd+.  If  SeR"*"'  is  invertible  then 
(SACS~\  SB„  QS-')e  and 

(3.19)  J{A„  B„  Cc)  =  J(SACS~\  SB„  C^S'1). 

Proof.  Although  the  result  is  obvious  from  system-theoretic  arguments,  we  shall 
prove  it  analytically  by  utilizing  elements  of  the  development  in  §  4.  Define 

Ho 

and  note  that  replacing  (A„  B„  Cc)_by  (SA^S*1,  SB„  C rS~')  is  equivalent  to  replacing 
A,  V  and  R  by  SAS~\  SVS *  and  S~*RS~',  respectively.  If  a,  f)  >0  satisfy  (3.6)  then 
a  straightforward  application  of  the  Hille-Yosida  theorem  [57,  pp.  153-5]  shows  that 


5  (3.14a)  refers  to  p($) » *i„  etc. 
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the  strongly  continuous  semigroup  generated  by  SAS~‘  satisfies  ||e^''j|S 
||S||  ||S-1 1| <*  e~ which  proves  the  first  assertion.  Since  S  e^'S'1,  t  S  0,  is  also  a  strongly 
continuous  semigroup  with  generator  SAS~\  it  follows  that  Se^'S'1  =  es*s  Hence 

[  eS/iS  ''(SVS*)  e(5AS~,)m'  dt  =  SQS* 

Jo 


and  (3.19)  follows  from  tr  QR  =  tr  (S<?5*)(S'*AS'').  D 

In  view  of  Proposition  3.1  one  would  expect  the  Main  Theorem  to  apply  also  to 
(SAfS-1,  SBn  C<S~l).  Indeed,  it  may  be  noted  that  no  claim  was  made  as  to  the 
uniqueness  of  the  ( G ,  M,  H-factorization  of  QP  used  to  determine  An  Bc  and  Cc  in 
(3.9)— (3.1 1 ).  These  observations  are  reconciled  by  the  following  result  which  shows 
that  a  transformation  of  the  compensator  state  basis  corresponds  to  the  alternative 
factorization  QP  =  (S~TG)T(SMS~l)(Sr)  and,  moreover,  that  all  (G,  M,  D-factoriz- 
ations  of  QP  are  related  by  a  nonsingular  transformation.  Note  that  r  remains  invariant 
over  the  class  of  factorizations. 

Proposition  3.2.  IfS  eR"‘x"«  is  invertible  then  G  £  S'  TG,  T  ^  ST  and  M  A  SMS' 1 
satisfy 

( 3.7 ) '  QP  -  G*Mf, 

(3.8) ’  fG*  =  /B[. 

Conversely,  if  G,  f  e  £®(3if, R"‘)  and  invertible  Me R"**"1  satisfy  (3.7)’  and  (3.8)',  then 
there  exists  invertible  SeR"'*"'  such  that  G  —  S~TG ,  T  =  SF  and  M  =  SMS'1. 

Proof.  The  first  part  of  the  proposition  is  immediate.  The  second  part  follows  by 
taking  S_^  M“irG*M“',_  noting  S~‘  =  MT G*M~l  and  using  the  identities 
f  G*MTG*  =  M  and  MTG*  -  TG*M.  □ 

The  next  result  shows  that  there  exists  a  similarity  transformation  which  simul¬ 
taneously  diagonalizes  QP  and  r. 

Proposition  3.3.  There  exists  invertible  <t>e8)(%)  such  that 


(3.20a,  b)  O  = 

a 

P  =  <J)*p 

(3.21a,  b)  QP  =  < 

o] 

T  =  d>~’£ 

where  A<j,  A^eR"'1"1'  are  positive  diagonal  and  A<jA p 

A  A  A  A 

(3.22a,  b) 

<? 

=  tQ, 

P=Pt. 

Proof.  Proceeding  as  in  the  proof  of  Lemma  3.1,  choose  an  orthonormal  basis  for 
X  with  respect  to  which 


[Q,  0 

1  and  °1 

L  o  o 

J  L  o  oj 

where  Q„  P,e  RrKr  are  nonnegative  definite.  By  [55,  Thm.  6-2.5,  p.  123],  there  exists 
invertible  ,p€Rrxr  such  that  A<)^'PQl^,T  and  A^  =  'P'TP,^”1  are  nonnegative 
diagonal.  Because  of  (3.14),  it  is  clear  that  ¥  can  be  chosen  so  that 


A<j  = 


and 
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where  A<j,  A^€R"'X"‘  are  positive  diagonal.  Thus  (3.20)  holds  with 


From  (3.20)  it  follows  that 


Now  define  G  =  [I„r  0]<t>“*,  M  =  \$\p  and  f  =  [/„,  0]4>  so  that  (3.7)'  and  (3.8)'  are 
satisfied.  By  the  second  part  of  Proposition  3.2  there  exists  invertible  SeR',‘xn'  such 
that  G  —  STG,  M  =  S-1MS  and  T  =  S"T.  Since  M  and  M  have  the  same  eigenvalues, 
M  =  A  (modulo  an  ordering  of  the  diagonal  elements)  and  thus  (3.21a)  holds.  Finally, 
(3.21b)  follows  from 

r  =  G*r  =  G*r  =  4>~‘ 0 

Remark  3.1.  Proposition  3.3  shows  that  A,,  •  •  • ,  A„c  are  the  positive  eigenvalues 
of  QP 

Remark  3.2.  The  simultaneous  diagonalization  in  (3.20)  has  been  effected  by  a 
contragredient  transformation  [55],  [58].  For  applications  of  this  type  of  transformation 
to  model  reduction  and  realization  problems  see  [12],  [59]-[61].  Simultaneous 
diagonalization  of  operators  is  discussed  in  [53,  p.  181]. 

The  following  result  validates  the  precise  handling  of  the  unbounded  operator  A 
in  (3.9),  (3.17)  and  (3.18). 

Proposition  3.4.  The  following  relations  hold : 

(3.23a,  b.c)  p(G)  =  p(T)  =  p(r)~  n„ 

(3.24a,  b)  r:X  -*2{A),  t*:X->2)(A*), 

(3.25a,  b)  G*:R"<->3(A),  r*:R"'-S(A*). 

Proof.  From  (3.8)  and  (2.1)  it  follows  that  nc  =  p(TG*)£  min  {p(T),  p(G*)}.  Since 
p(DSn„  p(G)  =  p(G*)  and  p(G)£n„  (3.23a)  and  (3.23b)  hold.  To  show  (3.23c) 
either  note  (3.21b)  or  use  (3.14a)  and  (3.22)  to  obtain 

",  =  p(<?)  =  p(rQ)  £  p(r)  -  p(G*DSp(D  =  n. 

To  prove  (3.24a)  note  that  (3.22a)  implies  &(Q)<=  Si(r)  and  thus  plQ)- p(r)  implies 
9i{Q)  =  3?(r),  and  similarly  for  (3.24b).  Finally,  (3.25)  follows  from  (3.23),  (3.24),  the 
definition  r  =  G*T  and  the  fact  that  r*  =  T*  G.  □ 

Since  the  domain  of  A  may  not  be  all  of  f€,  expressions  involving  A  require  special 
interpretation.  First  note  that  because  of  the  range  condition  (3.25a),  the  expression 
(3.9)  indeed  represents  an  nc  x  nc  matrix  (see,  e.g.,  [6,  p.  80]).  Similarly,  because  of 
(3.25b),  Aj  is  given  by 

(3.26)  Atc=G{A*-1Q-PT.)T*. 

With  regard  to  (3.15),  note  that  because  of  (3.12a),  the  right-hand  side  of  (3.15)  is  a 
linear  operator  with  domain  2{A*).  Since  6&-tQ2Q-Q1Qt*+V1  +  tQ1Qt*  is 
continuous  on  3>(A*),  AQ+QA *  has  a  continuous  extension  on  X  given  precisely  by 
-©.  Similar  remarks  apply  to  (3.16).  Analogous  domain  conditions  were  obtained  in 
[5]  for  a  deterministic  infinite-dimensional  linear-quadratic  control  problem  with 
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full-state  feedback.  Finally,  because  of  (3.24)  the  right-hand  sides  of  (3.17)  and  (3.18) 
denote  bounded  linear  operators  on  all  of  3€. 

It  is  useful  to  present  an  alternative  form  of  the  optimal  projection  equations 
(3.15)-(3.18).  For  convenience  define  the  notation 

J*-t. 

Proposition  3.5.  Equations  (3.15)-(3.18)  are  equivalent ,  respectively,  to 

(3.27)  0  =  AQ+QA*  +  V1-QIQ  +  t±Q1Qt*, 

(3.28)  0  =  A*P  +  PA  +  R1-PlP  +  r*PlPr±, 

(3.29)  0  =  (A-£P)Q  +  Q(A-SP)*  +  Q1Q- txQ2Qt*, 

(3.30)  0  « ( A  -  Q±)m  P  +  P(A  -  Ql)  +  PIP  -  t^PIRt^. 

Proof.  The  equivalence  of  (3.27)  and  (3.28)  to  (3.15)  and  (3.16)  is  immediate. 
Using  (3.22a)  in  the  form  Q=Qt*,  we  obtain  (3.17)  =  (3.29)r*.  Conversely,  from 
(3.22a)  and  [(A-2P)Q]*  =  Q(A-£P)*  (see,  e.g.,  [6,  p.  80])  it  follows  that  (3.29)  = 
(3.17)  +  (3.17)*-r(3.17).  Similarly,  (3.18)  and  (3.30)  are  equivalent.  0 

The  form  of  the  optimal  projection  equations  (3.27)-(3.30)  helps  demonstrate  the 
relationship  between  the  Main  Theorem  and  the  classical  LQG  result  when  dim  %!=  n< 
oo.  In  this  case  we  need  only  note  that  the  (G,  M,  T) -factorization  of  QP  in  the 
“full-order”  case  nc  =  n  is  given  by  G  =  Y  =  1„  and  M  =  QP.  Since  t=  /m  and  thus 
r±  =  0,  (3.27)  and  (3.28)  reduce  to  the  standard  observer  and  regulator  Riccati  equations 
and  (3.9)-(3.11)  yield  the  usual  LQG  expressions.  Furthermore,  note  that  in  the 
full-order  case 

(3.31)  Ac-  A  +  BCe  -  BcC 
and  (3.29)  and  (3.31)  can  be  written  as 

(3.32)  0  =(A'  +  BcC)Q+Q(A'  +  BcC)t+BcV2BJ, 

(3.33)  0  =  (Ac  —  BC')tP+P(Ac -  BCc)+Cj R 2Q. 

Since,  as  is  well  known,  the  stability  of  A  corresponds  to  the  stability  of  A+BCc  = 
Ac  +  BcC  and  A  -  BcC  =  Ac  -  BC„  it  follows  from  standard  results  (e.g.,  [62,  pp.  48, 
277])  that  the  positive-definiteness  conditions  (3.14a,  b)  are  equivalent  to  the  assump¬ 
tion  that  (A„  B„  £c)  is  controllable  and  observable. 

To  obtain  a  geometric  intepretation  of  the  optimal  projection  we  introduce  the 
quasi-full-state  estimate 

i(/)±G**c(/)eaf 

so  that  rx(t)  =  x(t)  and  xc(f)  =  ri(i).  Now,  the  closed-loop  system  (3.1  )-(3.4)  can  be 
written  as 

(3.34)  x(t)  =  Ax(t)-BCridc(t)+f/,w(i), 

(3.35)  i(t)  =  r(A  +  BCe  -  BcC)rx{t)+  rBc(Cx(t)+  H2w(0), 
where  (3.35)  is  interpreted  in  the  sense  of  (3.34)  since  x(r)e  X  and  where 

BcAQC*Vj',  C'±-Ri'B*P. 

It  can  thus  be  seen  that  the  geometric  structure  of  the  quasi-full-order  compensator  is 
entirely  dictated  by  the  projection  r.  In  particular,  control  inputs  rx(t)  determined  by 


OPTIMAL  PROJECTION  EQUATIONS 


135 


(3.35)  are  contained  in  &(r)  and  sensor  inputs  rB^yit)  are  annihilated  unless  they  are 
contained  in  [^"(r)]A  =  9?(r*).  Consequently,  9l{r)  and  9?(r*)  are  the  control  and 
observation  subspaces,  respectively,  of  the  compensator.  Since  r  is  not  necessarily  an 
orthogonal  projection,  these  (finite-dimensional)  subspaces  may  be  different. 

From  the  form  of  (3.35)  it  is  tempting  to  suggest  that  the  optimal  fixed-order 
dynamic  compensator  can  be  obtained  by  projecting  the  full-order  (infinite¬ 
dimensional)  LQG  compensator.  However,  this  is  generally  impossible  for  the  following 
simple  reason.  Although  the  expressions  for  A„  Bc  and  Cc  in  (3.9)-(3.11)  have  the 
form  of  a  projection  of  the  full-order  LQG  compensator,  the  operators  Q  and  P  in 
(3.9)-(3.1 1)  are  not  the  solutions  of  the  usual  LQG  Riccati  equations  but  instead  must 
be  obtained  by  simultaneously  solving  all  four  coupled  equations  (3.15)-(3.18).  This 
observation  reinforces  the  statement  made  in  §  1  that  the  optimal  fixed-order  dynamic 
compensator  cannot  in  general  be  obtained  by  LQG  followed  by  closed-loop  controller 
reduction  as  in  [14]  and  [IS]. 

We  now  give  an  explicit  characterization  of  the  optimal  projection  in  terms  of  Q 
and  P.  Since  QP  has  finite  rank,  its  Drazin  inverse  (QP)°  exists  (see  [63,  Thm._6,  p. 
108])  and,  since  {QP)2  =  G*M2Y,  and  hence  p{QP)2  =  p(QP),  the  “index”  of  QP  (see 
[63],  [64])  is  1.  In  this  case  the  Drazin  inverse  is  traditionally  called  the  group  inverse 
and  is  denoted  by  (OP)*  (see,  e.g.,  [64,  p.  124]  or  [65]). 

Proposition  3.6.  The  optimal  projection  r  is  given  by 

(3.36)  t=OP(OP)*. 

Proof.  It  is  easy  to  verify  that  the  conditions  characterizing  the  Drazin  inverse 
[63]  for  the  case  that  QPhas  index  1  are  satisfied  by  G*M~'T.  Hen ce(QP)0  =  G*M~'T 
and  (3.8)  implies  (3.36).  0  • 

We  now  give  an  alternative  characterization  of  the  optimal  projection  by  introduc¬ 
ing  the  following  notation  from  [51,  p.  73].  For  <fr,  i/re  define  the  operator  4>®ipe 
St(X)  by 

(d>®^)xA(x,  xe%, 

and  note  that  p(<6®i£)  =  1  if  <f>  and  are  both  nonzero  and  (<j>®t//)*-  i//®<f>.  Using 
this  notation,  (3.2la)  can  be  written  as 

(3.37)  <t>QP<t>~'  =  £  A,f(®£, 

i-1 

where  [fj}TL1  is  an  orthonormal  basis  for  X.  In  terms  of  the  Riesz  bases  (see  e.g.,  [52, 
p.  309]) 

i  =  1, 2,  •  •  • , 

(3.37)  is  equivalent  to 

(3.38) 

f-i 

which  can  be  regarded  as  a  specialized  spectral  decomposition  of  a  semisimple  operator. 
We  emphasize  that,  in  contrast  to  the  singular  value  decomposition  for  compact 
nonnorma!  operators  (see,  e.g.,  [50,  p.  261]),  the  A,  in  (3.38)  are  eigenvalues  of  QP 
(see  Remark  3.1),  not  singular  values.  Moreover,  although  and  are  bases 

for  X,  they  are  not  necessarily  orthogonal.  They  are,  however,  biorthonormal,  i.e., 
{4>*  <l'j)  =  8iJ,  and  hence  4>i®4/,  is  a  rank-one  projection  and  (d>,®  ifr,)(<£/®  ifry)  =  0,  i  *  j- 
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Since  r  is  a  rank-nc  projection,  it  is  not  surprising  that  r  is  given  precisely  by 
(3.39)  r-i 

<-i 

The  following  result  summarizes  the  above  observations. 

Proposition  3.7.  There  exist  biorthonormal  linearly  independent  sets  {0.}  T- 1  •= 
3>{A)  and  3l(A*^such  that  (3.38)  and  (3.39)  hold.  Furthermore,  if  the 

( G ,  M,  T)  -factorization  of  QP  is  chosen  such  that  M  =  A,  then,  for  all  x  e 

Gx  =  ((x,  t/tt),- ■  •  ,<x,t pn))T, 

rx=«x,  d>t),  ■  ■  •  ,  <x,  <t>n,))T- 

Remark  3.3.  Note  that  PQ  and  r*  are  given  by 

PQ-£  r*=  £  i®d>» 

i-t  f-i 

and,  for  all  .  • .  ,y„  )TeR"',  G *  and  T*  satisfy 

G*y  =  £  y,tj>h  T*y  =  £  yt<f>,. 

(-1  i-> 

4.  Proof  of  the  Main  Theorem.  We  state  and  prove  a  series  of  lemmas  which  allow 
us  to  compute  the  Frechet  derivatives  of  J  with  respect  to  A„  Bc  and  Cr  Requiring 
that  these  derivatives  vanish  leads  to  the  necessary  conditions  in  their  “primitive” 
form.  A  transformation  of  variables  then  leads  to  the  form  of  the  necessary  conditions 
(3.9)— (3.18). 

Let  “u-lim”  denote  the  uniform  limit  (i.e.,  limit  in  operator  norm)  for  bounded 
linear  operators  [50,  p.  150]  and,  for  strongly  continuous  S(f)e  St(Sif),  » SO,  interpret 
the  strong  integral  S(t)  dt  according  to  S(t)zdt,  re  [50,  p.  152].  Also  recall 
the  standard  fact  [6,  p.  186]  that  (eAl)*  =  e'**’  and  similarly  for  A.  Throughout  this 
section  let  ( A„  B„  Cc)  e  sd+  and  let  o,  (J  >  0  satisfy  (3.6). 

To  begin,  note  that  the  closed-loop  system  (3.1)-(3.4)  can  be  written  as 

(4.1)  £(t)  =  Ax{t)+Hw(t), 
where 

W±[B^Je  382(af'©R'). 

For  convenience  define  the  nonnegative-definite  operator 

In  terms  of  the  augmented  sute  x(t),  the  performance  criterion  (3.5)  becomes 

(4.2)  J(Aa  Ba  Cc)  =  lim  E(Ri(/),  x{t)), 

r-*oo 

where  the  nonnegative-definite  operator  R  is  defined  by 


».(*)• 
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To  write  (4.2)  in  terms  of  the  covariance  of  x(f),  recall  [6,  p.  308]  that  the 
covariance  “E[(£-Ef)(£-E£)*]”  of  a  Hilbert-space-valued  weak  random  variable  ( 
is  defined  to  be  the  nonnegative-definite  operator  S  which  satisfies 

(Sy,  z>  =  E<f-E£,  >•>(£- E£z> 

for  all  y ,  z  in  the  Hilbert  space.  Hence  define  [6,  p.  317] 

<?(f)AE[(x(0-Ex(r))(x(0-Ex(0n- 

Lemma  4.1.  Q&  u-lim,..*  <?(f)  exists  and  is  given  by 

(4.3)  <?=[  e*'Ve*''dt. 

Jo 

Furthermore, 

(4.4)  B„  Ce)  =  tr  QR. 


Proof.  First  compute  (as  in  [6,  p.  317]) 

(Q(t)y,  z)  =  E(x(<)  -  e*Ex(0),  y){x{t)  -  e^'ExfO),  z*> 

=  E^J  e'i<'-*>ifw(s)<fj,y^J  eM'-a)Hyiia)da,ij 
+  «?( 0)  eA''y,  e*'z) 

=  E  J  I  (w(s),H*e*‘i,-,)yXw('T),H*eA’l-i,)z)dsd* 

Jo  Jo 

+<r"'(?(0)  eA''y,z) 

=  f  (eA<'~’'Ve‘i'<'~’)y,  z>  ds  +  (eA'Q( 0)  e*'y,  z), 

Jo 

which  shows  that  Q(f)  is  given  by 

<?(f)  =  e^'OtO)  eA''+  j  eA,Ve*'$ds. 

Jo 


Clearly,  (4.3)  makes  sense  as  a  strong  integral  since 

||<?||  S  J*  \\eAl  VeA‘‘\\  dt  £  a2 1|  V||  J"  e~2p'  dt  <  oo. 

To  demonstrate  uniform  convergence  it  need  only  be  noted  that 
||<?-<?(r)||=  sup  ||«?-<?(f))y|| 

«y«-i 

=  sup  I  e'4*  VeA''yds-eA,Q(0)  eA*‘y 

lIJi 

£  J  ||e*  Ve4*’||  ds  +  ||e*Q(0)  e*’\\ 
Si«2||V|^-’e-J<,'-t-||Q(0)||  e-2t>>. 
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Next,  let  ■  be  an  orthonormal  basis  for  X  and  use  Parseval’s  equality  to  obtain 
Bn  Cf)  =  lim  E||P1/2£(f)||2  =  lim  E  £  <R'/2x(t),  *(>2. 

/— on  /-*  ,  „  j 

Since 


/SO, 

i-i 

is  nonnegative  for  each  n  and  is  increasing  in  n  for  each  r  with  limit  (Rx(t),  x(i)), 
monotone  convergence  permits  expectation-limit  interchange.  Hence  using  Ex(r)  = 
e*'£x(0)  we  have 


Bn  Cc)  =  lim  I  E(x(/),  &'**+,)* 

i-i 

=  lim  £  [<Q(t)R,/V,«'/V1>  +  (e/i,Ex(0),R,/Vi)i] 

=  lim  {tr[P1/2Q(t)Pl/2]+||P,/J  e^'Ex(0)||2} 

l-*oo 

which  by  Corollary  2.1  yields  (4.4).  □ 

We  shall  also  require  the  “dual"  of  <5  given  by 

(4.5)  P  =  £V*'/?e'5'df. 

Since  V  and  R  are  nonnegative  definite  it  is  readily  seen  that  Q  and  P  are  also 
nonnegative  definite. 

Lemma  4.2.  Q,  Pe9B,(#T). 

Proof.  It  suffices  to  consider  Q  only  since  the  situation  for  P  is  exactly  analogous. 
Since  Q  is  nonnegative  definite.  Lemma  2.3  can  be  used.  Letting  be  an 

orthonormal  basis  for  X,  we  have 

tr  Q  =  £  <*>,)  =  £  (  J  et'Ve*’'^  dt,  <f>^ 

-  lim  [  £  (Ve*'‘<t>heA’'<t>,)dt. 

n-3C  Jo  i- 1 

L et/„(f)  denote  the  above  integrand.  Since  V  is  nonnegative  definite,  {/„(•)}  is  a 
monotonically  increasing  sequence  of  nonnegative  functions  such  that  /„(<)-» 
tr  e‘i,VeA  ISO.  Hence,  by  monotone  convergence  and  Lemma  2.2, 

trQ  =  j  tr[e*'Ve'i’,]dt 

Wet'Ve^'ldtsSWVl^  e-2*'dt<°o.  D 

Lemma  4.3.  With  <5  and  P  given  by  (4.3)  and  (4.5)  il  follows  that 

tr  QR  « tr  VP. 


(4.6) 
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Proof.  For  any  orthonormal  basis  j  of  ft  we  have 

tr  QR=trRQ-  I  (^R  J  dt ,  <f> ^ 

f®  "  -  -  .  - 

=  lim  I  {ReA,VeA''4„<t>.)dt. 

"-“Jo  i-l 

Letting/,(r)  denote  the  above  integrand  it  follows  that  /„(r)->tr  R  eAl  V eA‘\  1 2  0,  and 
l/-(*)|a£  V e*  '4>»  R^i)| S  «z||  V||  e~20‘  £ 

(-1  i-i 

If  {d>,}7- 1  is  chosen  to  be  the  set  of  orthonormal  eigenvectors  of  R  then  Lemma  2.1 
implies  ,  ||K<k||  =  ||/?||i  and  thus  !/„(r)|  is  bounded  on  [0, 00)  by  an  integrable 
function.  Hence  by  dominated  convergence, 

tr  QR  =  I  tT[ReA,VeA'']dt  =  f  trie'5*'!?  eA'  V]  dt  =  f  £  <  V<f>„  eA‘‘R  eA')  dt. 

Jo  Jo  Jo  i-l 

And  again  using  dominated  convergence, 

tr  QR  •  £  |  <  V<f>h  eA’'R  e*'*,)  dt  =  £  (  V&,  f  e^'R  eA'<t>,  dt)  •  tr  VP.  □ 
i-l  Jo  i-l  \  Jo  / 

The  next  result  is  important  in  that  it  allows  us  to  treat  Q  and  P  as  solutions  of 
dual  algebraic  Lyapunov  equations.  For  a  similar  result  involving  groups  rather  than 
semigroups  see  [50,  pp.  555-557]. 

Lemma  4.4.  Q  is  given  by  (4.3)  if  and  only  if  Qe  9&(ft)  satisfies 

(4.7)  Q:3(A*)-+9(A), 

(4.8)  0  =  AQ  +  QA*  +  V, 

where  (4.8)  holds  in  the  sense  discussed  in  §  3.  Furthermore,  P  is  given  by  (4.5)  if  and 
only  if  Pe  SB  {ft)  satisfies 


(4.9) 

(4.10) 


P:  9(A)-*  3(A*), 
0=  A*P+  PA+  R. 


Proof.  We  consider  Q  only.  To  prove  necessity  let  f'>0.  Then  for  all  re[0,  r') 
and  xe  9(A*)  we  can  write 


?i'Qe*'x=  f 
Jo 

■1 


A(«+J>y  A*<r'+»>- 


xds 


=  ‘e^Ve*'"  eA*u'~,yxdo. 


Hence, 

(4.11) 


4  eA,QeA''x  =  -  f  *  e'*'  VeA'°  eA’i'-)A*x  do  -  eA‘  VeA''  x, 
dt  J, 


which  shows  that  eA'QeA*'  is  strongly  differentiable  with  respect  to  t  for  all  re  [0,  /')• 
In  particular,  setting  r  =  0  it  follows  that  QeA*'  xe  3(A)  for  all  xe  9(A*)  (see,  e.g., 
[6,  p.  173]  or  [50,  p.  485]).  Performing  the  differentiation  on  the  left-hand  side  of 
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(4.11)  and  setting  t  =  0  yields 

(4.12)  AQeA*'x  =  -J  e*" ex''A*xdo-  VeA*'x. 

Now  fix  xe  S(A*).  Then  for  (i,}“  ,,  fi>0,  we  have 

QeX’‘‘xea>(A),  «  =  1,2,3,  ••  •, 

Qe*‘'x - ►  Qx. 

i-*cc 

Now  consider  the  sequence  {AQ  e'*’,|x}“  i-  Letting  f’  =  f,  in  (4.12)  and  using  dominated 
convergence  to  interchange  limit  and  integration  ( A*x  is  a  fixed  element  of  PC),  it 
follows  that 

(4.13)  lim  AQe*''x  =  -\  eXaV  ex'°  A*xd<r-Vx. 

Jo 

Since  A  is  closed,  <?x  e  3(A).  This  proves  (4.7).  Also,  since  A  is  closed  we  have 

lim  AQ  e*‘'x  =  AQx, 

<-•00 

which  with  (4.13)  implies 

AQx  =  -QA*x-Vx, 

and  hence 

(AQ+QA*  +  V)x  =  0,  xe  ®(A*), 

as  desired. 

To  prove  sufficiency  let  xe3(A).  Then  eA*'xe  ®(A*),  r3=0,  and  hence 
4  e*'Q  eX’‘x  m  e*‘{AQ  +  QA*)  e^'x. 


Thus 


e‘i*'x-<?x=J  eXl(AQ  +  QA*)  ex’’xds,  xe3 t(A*). 


Extending  AQ  +  QA*  to  all  of  PC  we  obtain 

ex,Q  eXm,x  -  Qx  =  -  j  eA’Vex’’xds,  xzfc. 

Jo 

Letting  t-*oo  yields  (4.3).  □ 

We  now  introduce  some  notation  which  will  prove  to  be  most  convenient  in  the 
following  results.  For  (A’c,  B'c,  C^eR"'*"'  xRm<xl  xRmXH‘  define 

«Bcab;-bct  8Cr±c'c-cc 


and 


I(*a,*^)IM*aJ+IVJ+I«cvI- 

Furthermore,  let  A’,  V'  and  R'  denote  A,  V  and  R  with  (A„  B„  Cc )  replaced  by 
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(A'„  B'c,  C'c)  and  define 


{f4  V’-V=[^  ®  1 

Lo  BcV36l+8aV2Bl+8B  v2sir 

0  1 

LO  CTR2&c+ScR2Ct  +  8lR28cJ 

We  shall  also  write  Q',  P'  for  Q,  P  as  given  by  (4.3)  and  (4.5)  with  A,  V,  R  replaced 
by  A',  V',  R'  and  define 

4  <?'-<?>  8p±P'~P. 


Lemma  4.5.  si  is  open. 

Proof.  Let  (A*  B„  Ce)e.si  be  arbitrary  and  consider  the  open  set 

(4.14)  N  A {( A,,  B'e,  Ci)eR"'*"‘XR"<“'xR,"x"«:  ||(S*„  8a„  8Ct)\\<p/2ay), 

where  y^max{l,  ||S||,  ||C||}.  Then,  since  A'  =  A  +  8&  and  8*  e  95(2?)  it  follows  from 
Theorem  2.1,  p.  497  of  [50],  that  for  all  (A'c,  B'c,  C'c)e  N  and  rgO, 

|e*'|  £  a  £  a  e~0,n. 

Hence,  Nc^as  desired.  □ 

Lemma  4.6.  There  exists  c>0  such  that 


(4-15)  116,511  Sc|l(6^«»„«cJ||, 

(4-16)  ||8A||Sc||(6/4„8e<,5c)||. 


for  all  (A',  B'c,  C'c)e  N,  where  Nc  si  is  the  open  neighborhood  of  (A„  B„  Cc)  defined 
by  (4.14). 

Proof.  We  consider  (4.15)  only.  Since  Hem'll  Sare-^2,  rgO,  (A',  B'c,  Cc)e  N,  it 
follows  that 


r 


||fid||S  We^'V'e^'-e*' VeA'’||  dt 
Jo 


s  J*  {Ill’ll  II  V'H  I! e*-'  -  ***|  +  II e*'|  ||5*||  Ilex'll  +  |j «*'  -  «*I  I!  V||  || eA*,]|>  rf/ 

(4.17)  S«(||V|!  +  |M)  f”  e~0,/2  dt 

Jo 

+  a2|| 8*||  J  e -301'2  dt  +  a\\  V\\  J  «* ||  e~0,n  dt 


-  a(2||  V||  +  »6*||)  J  "  hU+'»' ~  e^e-*'2  dt+~  ||6*||. 

From  [50,  p.  497],  it  follows  that  the  perturbed  semigroup  has  an  expansion 

u,(t),  ISO, 
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where  U,(t)€  9B(#),  rSO,  satisfy  the  estimates 
Hence,  for  all  (A'e,  B'c,  C’c )  e  N, 

(4.18)  ||e n g  £  |I/l(i)|Sa«“*[e“'*'‘,,-l]. 


From  (4.17),  (4.18^  and  the  relations  ||«A||  £  y||(5Ac,  8„c,  «c,)||  <  P/2  a  and 

dtc^l (8A,  SB,  8c.) || 

it  follows  that 

IIM  (211  V||  +  ||5v||)||(«Ac,  8m„  8c.) || 

+^(2||flcV2|il|6BJ|  +  1|V211||5BJ12), 

which  yields  (4.15).  □ 

Since  Q,  P  e  we  can  write 


\0x 

H 

p.\f- 

P\2 

L<?fz 

ch  r 

Uf. 

P2  J 

where  Q.eS 8 (ST),  Que  98  (R\  X),  <?2e  R"'*"-  and  similarly  for  P„  P12  and  P2.  Note 
that  <?i,  <?i,  P,  and  P2  are  nonnegative  definite.  Also,  define  the  notation 


where 


+  P i2(?’:,  2|2^P]Q12+P12Q2, 

Zj.APkQ.  +  P.Qk,  Z2APf2Q)2+P2Q2, 

and,  for  ( A'c ,  Be,  C<)  e  jrf,  let 

*/(«a„  «a„  SCr)  Aj(A’n  B\,  C'c)—J(A„  Ba  Cc). 
Lemma  4.7.  Let  (A',  B'c,  C'c)  e  Then 

(4.19)  8j(8A',  8b,  8c.)  =  if (6*,,  SB;,  6C,)  +  o(||(«^  5flc,  *c.)|), 
where 

(4.20)  &(8a.,  8Bc,  5cc)^2tr[Z25At]  +  2tr[(  V2BfP2+CZ2))6BJ 

+  2tr«?2CcTP2  +  Zr2B)5cJ 

and 


(4.21) 


^  ll(«A.  *c,)ir,o(||(«At,  &B„  8c, ) II )  =  0. 


Proof.  Combining  (4.8)  and  (4.10)  with  (4.6),  J  can  be  written  as 
/(A„  Bn  Ct)  =  tr  [<?£  +  PV]+i  tr  [<?  cl  (A*P+  PA)  +  P  cl  (A<?+  <?A*)], 
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and  likewise  for  (A'CJ  B’c ,  C’c),  where  “cl”  denotes  closure  (i.e.,  extension)  of  a  bounded 
operator  to  all  of  ft.  Now  using  the  identity 

tr  [Q'R'  +  P'  V']  -  tr  [  QR  +  P  V]  =  tr  [  Q8*  +  PS  +  tr  [  SqR '  +  Bp  V'] 
we  can  compute 

Sb.,  «c.)  =  tr  [Q8p  +  P8f]  +  l  tr  [Q  cl  (A*(P  +  8p)  +  (P  +  Sp)A')] 

-»-2  tr  [So  cl  (A'*P'  +  P'A')] 

+  ll  tr  [P  cl  (A'( <?  +  6<5)  +  (Q  +  8q) A'*)] 

+  ^tr[5^  cl  (A'Q'+  (p'A'*)] 

~J  tr  [Q  cl  (A*P  +  PA)  +  P  cl  (A(?+<?A*)] 

+  tr  [$$£'+ fi/s  V']. 

Using  ft  =  A  +  8z  and  combining  the  second,  fourth  and  sixth  terms  yields 

8j  ( &ac,  5®,,  8c, )  =  A  +  n, 

where 

A±u[Q8ii+P8i]+'iU[Q(8*tP+P8t)  +  P(8iQ+Q8l)] 

=  tr[<?5il  +  P5v3  +  2tr[«/iOP] 


and 

ft  A  '2  tr  [ Q  cl  (A'* 8p  +  8pA’)  +  P  c\  ( A’ 8q+  6*5 A'* )] 

+  |tr[5<5cl(A'*P'+P'A')+6ACl(A'<?'+(?’A'*)]  +  trt5o«'+6pV']. 


Computing 

lT[Q8t+P8y]  =  2 tr [  V2 Bj P28B,]  +  Ur[Q2Cj P2ficJ  +  tr [P28B  V28tBi  +  Q28TcR28Cc] 
and 


2  tr  [ 5* QP]  =  2  tr  [Z2 +  2  tr  [ CZ?,  SB, ]  +  2  tr  [Zf2B8Ct ] 

and  retaining  first-order  terms,  we  obtain  (4.20). 

To  evaluate  O,  use  (4.8)  and  (4.10)  to  replace  R'  and  V'  i.i  the  last  term  in  fl  and 
write  A'  =  A  +  8*,  to  obtain  , 


(4.22) 


ft  =  jtr[Q  cl  ( A*8p  +  BpA)  +  P  cl  (AS<j  +  5<}A*)] 

+  itrt<?(556p+5p5A)+^(fiA«<5+5<}^)] 

- 1  tr  [8$  cl  ( A'*P'  +  P'A')  +  8p  cl  ( A'<?'  +  Q'A'*)]. 


Next  we  note  that 


(4.23)  tr [Q  cl  (A*8p  +  6pA*)]  =  tr  [5>  cl  (A<?+QA*)]. 


To  see  this  we  observe  that  by  arguments  similar  to  those  used  in  the  proof  of  Lemma 
4.4  and  the  fact  that  8p:  2(A)-*  2 (A*)  it  follows  that 

e*'  cl  (A* 6p+6pA)  e*'  dt. 

Jo 

Now,  using  the  technique  of  Lemma  4.3  with  the  role  of  R  played  by  -cl  (-4*5*  +  SpA), 
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we  see  that 

tr  [<?  cl  (A*5,+  6/sA)]  =  -tr  [6*  V]  =  tr  [5,  cl  (A<?  +  <?A*)]- 
Similarly,  it  can  be  shown  that 

(4.24)  tr  [P  cl  045,5  +  5$  A*)]  =  tr  [5$  cl  (A*P  +  PA)]. 

Now  substitute  (4.23)  and  (4.24)  into  (4.22)  and  rearrange  the  second  term  in  (4.22) 
so  that 

A  =  ]tr[5,5  cl  ( A* P+ PA) +  6* cl  (AQ+QA*)] 

+|  tr  [5<J(5$P+  P5,{>+  5,(5^0+035)) 

-\lr [5$ cl  ( A'*P'+  PA ')  +  5, cl  (A'0'+  Q'A'*)] 

=  -]  tr  [5^  cl  (A'*8f  +  5,A')  +  5,  cl  ( A'6,5  +  5^/4'*)]. 

Using  (4.8)  to  obtain 

0  =  A'8,5  +  8$A'*  +  8a  0  +  05^  +  5v 

and  (4.10)  to  obtain  a  similar  relation  involving  P,  we  have 

A  =  tr  [5$(55P+  P5/t  +  5j{)]  +  tr  [5^0  +  Q8^  +  5^)]. 

Restricting  (A',  B'c,  C'c)  to  N  (see  (4.14)),  using  Lemma  4.6  and  noting  that  5*  and 
8a  have  finite  rank,  it  follows  that  there  exists  c,  >  0  such  that 

(4.25)  ||A||Sc1||<6a,,5b„5Cc)||2. 

Combining  A  with  the  second-order  terms  in  A  yields  the  desired  result.  □ 

Lemma  4.8.  sd+  is  open. 

Proof.  From  the  “generic”  property  of  controllability  and  observability  [62,  p.  44] 
there  exists  an  open  neighborhood  of  ( A„  B„  Ce)  each  of  whose  elements  is  minimal. 
Combining  this  fact  with  Lemma  4.5  yields  the  desired  result.  □ 

Lemma  4.9.  Q2  and  P2  are  positive  definite. 

Proof.  First  note  that  expanding  the  Rn‘*"‘- component  of  the  Lyapunov  equation 
(4.8)  yields  (4.50)  below.  By  a  minor  extension  of  results  from  [66]  or  [67],  (4.50)  can 
be  rewritten  as 

0=  (A.  +  BcCQuQ;)Q2+  Q2(Ac  +  BcCQnQl)T+  BCV2BTC, 

where  Q2  is  the  Moore-Penrose  or  Drazin  generalized  inverse  of  Q2.  Next  note  that 
since  (A„  Bc)  is  controllable  then  so  is  (Ac  +  BeCQl2Q2,  BcV\n).  Now,  since  Q2  and 
BcV2Bj  are  nonnegative  definite,  it  follows  from  [62,  Lemma  12.2]  that  Q2  is  positive 
definite.  Similar  arguments  show  that  P2  is  positive  definite.  □ 

Having  established  Lemmas  4. 1-4.9,  we  can  now  proceed  with  the  proof  of  the 
Main  Theorem.  Let  (A„  Bc,  Cc)e  si*  be  as  in  the  Main  Theorem  and  consider  (4.19) 
with  (A,,  B'c,  C'c)  confined  to  jrf*.  Because  if:  R^*"*  xR"'xl  xR">">-»R  is  a  bounded 
linear  functional  and  sd+  is  open,  the  convergence  in  (4.21)  implies  that  if  is  precisely 
the  Frechet  derivative  of  J  with  respect  to  (A„  Ba  Ce).  Since  si+  is  open,  the  optimality 
of  (Ac,  Bct  Cc)  implies 

(4.26)  if(5„,,5.r,5c,)  =  0 
for  all  (5Ar,  5Br,  5C,).  Clearly,  (4.26)  is  equivalent  to 

(4.27)  Zj-0, 
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(4.28)  V2UjP2  +  CZ  21  =  0, 

(4.29)  Q2CjR2  +  Z*2B  =  0. 

Thus,  Bc  and  Cc  are  given  by 

(4.30)  Bc  =  -P2‘Z2,C*  V2‘, 

(4.31)  Cc  =  ~R2‘  B*ZI2Q2'. 

Although  Bc  and  Cc  are  now  determined  in  terms  of  Q  and  P,  Ac  remains  to  be 
found.  Moreover,  Q  and  P  themselves  depend  (via  (4.8)  and  (4.10))  on  Bc  and  C<- 
Hence  our  task  now  is  to  consolidate  and  simplify  (4.7)-(4.10),  (4.27),  (4.30)  and  (4.31) 
to  obtain  the  more  tractable  conditions  (3.9)-(3.18).  To  this  end  let  us  define  new 
variables 

(4.32a,  b)  Q*Q,-QaQVQt»  P±P,-P,2P2-'P*( 

(4.33a,  b)  P±P,2P2"P*2. 

Clearly,  Q  and  P  are  nonnegative  definite  and  have  finite  rank.  Since  by  Lemma  4.2 
Q,  Pe  9B,(^).  it  can  be  seen  that  Qu  P,  e  58,(Sif),  which  implies  Q,  Pe  98,(5if).  To  show 
that  Q  and  P  are  nonnegative  definite,  note  that  Q  is  the  58(5if)-component  of  the 
nonnegative-definite  operator  3.Q2.*  e  38 (3f),  where 

24[o  ‘-f '] 

Similarly,  P  is  nonnegative  definite. 

From  the  domain  conditions  (4.7)  and  (4.9)  it  follows  that 

(4.34a,  b)  Q,:3(A*)-*2HA),  P,:2>(A)-»2!(A*), 

(4.35a,  b)  Qi2:R"'-*3(A),  Pi2:R"<- ®(A*), 

which  lead  to  (3.12)  and  (3.13). 

Next  note  that  (4.27)  is  equivalent  to  (3.8)  with 

(4.36a,  b)  G±Q;'Q*2,  TA-PJ'P* 

and  that  (3.7)  holds  with 

(4.37)  M  A  Q2P2. 


Since  Q2  and  P2  are  positive  definite.  Lemma  2.6  implies  that  M  is  positive  semisimple. 
We  can  also  define  r=  G*f  which,  by  (3.8)  satisfies  rJ  =  r.  It  is  helpful  to  note  the 


identities 

(4.38a,  b) 

Q  =  Ql2G=G*<?r2,  p=-pl2r 

(4.39a,  b) 

q  =  g*q2g,  p  =  r*p2r. 

(4.40a,  b) 

r G*  =  G*,  rr  =  r. 

(4.41a,  b) 

<?=r<?,  P=Pr, 

(4.42) 

QP=-Q»Pli 

From  (3.8)  and  (2.1)  it  follows  that 

(4.43a,  b) 

p(G)  =  p(D  =  nc, 

(4.44a,  b) 

P(Qu)  =  P  (  P\  2  )  =  "r- 
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Hence,  (2.2)  and  (4.38)  imply  nc  =  p(Qt2)  +  p(G)- ne£  p(Q)£  p(Qx2)  =  n„  which 
yields  (3.14a).  Similarly,  (3.14b)  holds  and  (3.14c)  follows  from  (2.2)  and  (4.42). 

Using  (4.38)  and  (4.39),  the  components  of  Q  and  P  can  be  written  in  terms  of 
G,  T,  <?,  P,  Q  and  P  as 

(4.45)  <?,  =  <?+<?,  P,  =  P+P, 

(4.46)  <?12=Qr*,  P,,=  -PG\ 

(4.47)  <?2  =  r<?r\  Pj  =  GPG*. 

Now  (3.10)  and  (3.11)  can  be  obtained  by  substituting  (4.45)-(4.47)  into  (4.30)  and 
(4.31). 

Expanding  the  58(2?),  S8(R"‘,  2?)  and  components  of  (4.8)  and  (4.10)  yields 

(4.48)  0  =  AQ>  +  Q]A*  +  BCcQl2+Q,2(BCcy+  V„ 

(4.49)  0  =  AQx2  +  Qi2AJ  +  BCcQ2  +  <?,  ( BcC  )*, 

(4.50)  0  =  AcQ2+  Q2Aj  +  BcCQn+  Qt2(BcC)*+ BcV2Bj, 

(4.51)  0  =  A*PX  +  PxA  +  (BcC)*Pt2+  Px2BcC  +  Rx, 

(4.52)  0  =  PX2AC  +  A*Px2  +  (BcC)*P2+PxBCn 

(4.53)  0  =  Aj  P2  +  P2A'  +  (BCc)*P,2  +  P^BC,  +  Cj  R2C<. 


Substituting  (4.45)-(4.47)  into  (4.48)-(4.53),  using  the  identities 


BcC  =  rQ±,  BCc  -  -IPG*, 

BcV2BJ  •  TQlQr \  Cj  R2Cc  «  GP2PG\ 

and  defining 

A0±A-Ql,  Ap±A-1P, 

we  obtain 


(4.54) 

(4.55) 

(4.56) 

(4.57) 

(4.58) 

(4.59) 


0  =  AQ  +  QA*  +  ApQ  +  QAP  +  V„ 

0  =  [  ApQ+  QlQ  +  Q(T*Aj  G  +  £<?)JH, 

o=r[GMcr(?+(?!(?+(?S(?+(?(rMtrc+s(?)]r*, 

0=  A*P  +  PA  +  AqP+  PAq+  Rx, 
0=-[A$P+PIP+P(GMcr  +  2P)]G*, 

0=  G[r*AcrGP+  P2P+  P2P  +  P(G*Arr  +  2P)]G*. 


We  are  now  in  a  position  to  determine  Ae  by  computing  (4.56) -T(4.55)  which 
yields  (3.9).  Alternatively,  Ac  can  be  obtained  by  computing  (4.59)+  G(4.58).  As 
mentioned  in  §  3,  (3.9)  is  valid  since  G*:Rn,-»  2(A)  and  Aj  is  given  by  (3.26). 

Next  we  substitute  the  expressions  for  Ac  and  Aj  into  (4.55),  (4.56),  (4.58)  and 

(4.59)  and  compute  the  relations  (4.55 )G,  G*(4.56)G,  -(4.58)r  and  T*(4.59)r  to 
obtain,  respectively, 


(4.60)  0  =  [A^+<?A?+<?£Q]t*, 

(4.61)  0=t[ApQ+QAJ+<?I<?]t*, 

(4.62)  0=[AqP+  PAq  +  P2PJt, 

(4.63)  0=r*(AjP+PA<?  +  PIP]r. 
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Note  that  (4.60)-(4.63)  are  equivalent  to  (4.55),  (4.56),  (4.58)  and  (4.59)  since  G  and 
T  have  full  rank.  Since  (4.61)  =  t(4.60)  and  (4.63)  =  r*(4.62),  (4.61)  and  (4.63)  are 
superfluous  and  can  be  omitted.  Thus  we  have  derived  (3.17)  and  (3.18). 

To  obtain  (3.15)  and  (3.16)  we  need  only  compute  the  relations  (4.54)  +  t(4.60)  - 
(4.60) -(4.60)*  and  (4.57) +  r*(4.62)- (4.62) -(4.62)*  and  use  (4.41). 

Finally,  to  show  that  the  preceding  development  entails  no  loss  of  generality  in 
the  optimality  conditions  we  now  use  (3.9)— (3. 1 8 )  to  obtain  (4.7)-(4.10)  and  (4.27)- 
(4.29).  Let  A„  B„  C„  G,  T,  r,  Q,  P,  Q,  P  be  as  in  the  theorem  statement  and  define 
<?,,  Qa,  Oz,  P\,  P\ 2,  P2  by  (4.45)-(4.47).  Note  that  (3.12)  and  (3.13)  imply  (4.34)  and 
(4.35)  and  hence  (4.7)  and  (4.9).  Using  (3.8),  (3.10),  (3.11)  and  (3.22)  it  is  easy  to 
verify  (4.27)-(4.29).  Finally,  substitute  (4.32),  (4.33)  and  (4.36)  into  (3.15)-(3.18), 
reverse  the  steps  taken  earlier  in  the  proof  and  use  (3.9)-(3.11)  to  obtain  (4.8)  and 
(4.10),  which  completes  the  proof.  □ 

5.  Concluding  remarks.  This  paper  has  considered  the  problem  of  quadratically 
optimal,  steady-state,  fixed-order  dynamic  compensation  for  linear  infinite-dimensional 
systems.  The  Main  Theorem  presents  the  stationarity  conditions  of  the  optimization 
problem  in  a  highly  simplified  and  rigorous  form.  The  “optimal  projection  equations" 
(3.15)-(3.18)  (or,  equivalently,  (3.27)-(3.30))  of  the  Main  Theorem  reveal  the  essential 
structure  of  the  first-order  necessary  conditions  and  display  the  central  role  played  by 
the  optimal  projection  r.  The  relationship  of  the  Main  Theorem  to  the  standard 
finite-dimensional  steady-state  LQG  problem  can  be  demonstrated  by  replacing  r  with 
the  identity  matrix  and  noting  that  (3.27)  and  (3.28)  reduce  immediately  to  the  familiar 
pair  of  operator  Riccati  equations  and  that  (3.29)  and  (3.30)  yield  the  controllability 
and  observability  gramians  of  the  controller. 

Inasmuch  as  the  Main  Theorem  is  a  fundamental  generalization  of  classical 
steady-state  LQG  theory,  a  number  of  issues  must  be  reexamined.  Hence,  in  conclusion 
we  should  like  to  point  out  some  possible  extensions  of  the  Main  Theorem  along  with 
directions  for  further  research. 

1.  Sufficiency  theory'.  Although  sufficient  conditions  for  the  existence  of  an  optimal 
compensator  were  not  investigated  in  this  paper,  auxiliary  conditions  based  upon  the 
structure  of  (3.15)-(3.18)  could  perhaps  be  imposed  upon  Q,  P,  Q  and  P  to  single  out 
the  global  optimum  from  amongst  the  local  minima.  This  would  be  similar  to  the 
situation  in  LQG  theory  where,  under  stabilizability  and  detectability  hypotheses, 
optimal  stabilizing  Q  and  P  are  identified  as  the  unique  nonnegative-definite  solutions 
of  the  pair  of  algebraic  Riccati  equations. 

2.  Stabilizability.  Just  as  in  the  full-order  LQG  problem,  one  would  expect  a 
natural  relationship  between  the  structure  of  the  optimal  solution  and  stabilizabil- 
ity/detectability  hypotheses.  The  results  of  [41],  [42]  and  [68]  could  serve  as  a  starting 
point  in  this  regard. 

3.  Numerical  algorithms.  In  practical  situations,  the  distributed  parameter  system 
would  be  replaced  by  a  high-order  discretized  model  for  which  the  matrix  version 
(rather  than  the  operator  version)  of  the  optimal  projection  equations  could  be  solved 
numerically.  A  numerical  algorithm  for  solving  the  matrix  version  of  the  optimal 
projection  equations  has  been  developed  in  [32]  and  [34].  The  proposed  computational 
scheme  is  fundamentally  quite  different  from  gradient  search  algorithms  [17],  [18], 
[21],  [22],  [24],  [25],  [28],  [30]  in  that  it  operates  through  direct  solution  of  the  optimal 
projection  equations  by  iterative  refinement  of  the  optimal  projection. 

4.  Convergence.  One  of  the  principal  uses  for  the  optimal  projection  equations 
will  be  to  understand  the  relationship  between  fixed-order  dynamic-compensator 
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designs  which  are  optimal  with  respect  to  approximate  models  and  the  optimal 
fixed-order  dynamic  compensator  for  the  distributed  parameter  system  itself.  By  con¬ 
sidering  a  sequence  of  nth-order  approximate  models  which  converge  to  the  distributed 
parameter  system,  conditions  would  be  sought  guaranteeing  that  the  sequence  of 
fixed-order  compensators  based  on  each  approximate  model  approach  the  optimal 
dynamic  compensator  based  upon  the  distributed  parameter  system  (see  [38]-[40]). 
This  approach  is  analogous  to  the  convergence  results  obtained  in  [7],  [8]  with  the 
major  difference  being  that  the  optimal  projection  equations  permit  the  order  of  the 
compensator  to  remain  fixed  in  accordance  with  real-world  implementation  constraints 
whereas  in  [7]-[9]  the  order  of  the  compensator  increases  without  bound. 

5.  Unbounded  control  and  observation.  An  important  generalization  of  the  problem 
considered  in  this  paper  involves  the  case  in  which  the  input  and  output  operators  B 
and  C  are  unbounded.  The  mathematical  details  for  this  problem  are  considerably 
more  complex  (see,  e.g.,  [69]). 

6.  Singular  observation  noise/singular  control  weighting.  As  pointed  out  in  [22], 
[33],  [36]  the  assumptions  of  nonsingular  control  weighting  and  nonsingular  observa¬ 
tion  noise  preclude  the  use  of  direct  output  feedback  as  in 

(5-1)  u(t)  =  Crxr(t)+Dry(t) 

since  J  is  undefined  unless 


tr [Dj R2D'V ,]  =  0(0  R2DcV2  =  0). 


Although  with  due  attention  to  (5.1)  direct  output  feedback  can  be  used  in  the  singular 
case,  the  nature  of  the  problem  forebodes  all  of  the  difficulties  associated  with  the 
singular  LQG  problem.  Note  that  the  deterministic  output  feedback  problem  [70], 
when  viewed  in  this  context,  is  highly  singular. 

7.  Discrete-time  system/ discrete-time  compensator.  Digital  implementation  can  be 
modelled  by  a  discrete-time  compensator  with  control  of  a  continuous-time  system 
facilitated  by  sampling  and  reconstruction  devices.  See  [71],  [73]  for  results  in  this 
direction. 

8.  Cross  weighting/ correlated  disturbance  and  observation  noise.  This  extension  is 
straightforward  and  entirely  analogous  to  the  LQG  case  (see,  e.g.,  [18,  p.  351]). 
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Abstract 

In  controlling  distributed  parameter  systems  it  is  often  desirable  to  obtain  low-order,  finite¬ 
dimensional  controllers  in  order  to  minimize  real-time  computational  requirements.  Standard  ap¬ 
proaches  to  this  problem  employ  model/controller  reduction  techniques  in  conjunction  with  LQG 
theory.  In  this  paper  we  consider  the  finite-dimensional  approximation  of  the  infinite-dimensional 
Bernstein/Hyland  optimal  projection  theory.  Our  approach  yields  fixed-finite-order  controllers 
which  are  optimal  with  respect  to  high-order,  approximating,  finite-dimensional  plant  models.  We 
illustrate  the  technique  by  computing  a  sequence  of  first-order  controllers  for  one-dimensional, 
single-input/single-output,  parabolic  (heat/diffusion)  and  hereditary  systems  using  spline-based, 
Ritz-  Galerkin,  finite  element  approximation.  Our  numerical  studies  indicate  convergence  of  the 
feedback  gains  with  less  than  2%  performance  degradation  over  full-order  LQG  controllers  for  the 
parabolic  system  and  10%  degradation  for  the  hereditary  system. 
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1.  Introduction 


Approximation  methods  for  the  optimal  control  of  distributed  parameter  systems  have  been 
widely  studied.  In  particular,  the  approach  taken  in  [1-12]  involves  approximating  the  original 
distributed  parameter  system  by  a  sequence  of  finite-dimensional  systems  and  then  using  finite¬ 
dimensional  control-design  techniques  to  obtain  a  sequence  of  approximating,  sub-optimal  control 
laws,  observers,  or  compensators.  Furthermore,  in  these  treatments  it  was  demonstrated  that  if 
the  open-loop  system  is  approximated  appropriately,  then  it  is  possible  to  guarantee  convergence 
of  the  sequence  of  sub-optimal  controllers,  observers,  or  compensators,  respectively,  to  the  optimal 
controller,  observer,  or  compensator  for  the  original  infinite-dimensional  system.  In  addition,  it 
can  also  be  shown  that  when  the  approximating  sub-optimal  control  laws  or  estimators  are  applied 
to  the  original  system,  near-optimal  performance  can  frequently  be  obtained.  These  ideas  were 
pursued  in  the  context  of  both  open-  and  closed-loop  control,  in  both  continuous  and  discrete- time, 
and  for  both  full-state-feedback  control  and  LQG  (i.e.,  Kalman- filter-based)  state  estimation  and 
compensation. 

In  practical  situations,  however,  it  is  often  of  interest  to  obtain  the  simplest  (i.e.,  the  lowest 
order)  controller  which  provides  a  given,  desired  feedback  performance.  This  is  usually  achieved 
in  one  of  two  ways.  Either  the  plant  approximation  order  is  reduced  prior  to  controller  design,  or, 
alternatively,  reduction  techniques  are  applied  to  a  given  high-order  control  law.  Unfortunately, 
the  former  approach  may  result  in  undesirable  spillover  effects  while  the  latter  may  yield  low-order 
controllers  of  low  authority  which  perform  unacceptably.  In  fact,  with  the  second  approach,  this 
may  occur  even  when  a  suitable  controller  is  known  to  exist.  For  example,  as  is  shown  in  [13], 
controller  reduction  techniques  may  even  destabilize  the  closed-loop  system. 

A  third,  more  direct  approach  involves  fixing  the  controller  order  a  priori,  and  then  optimizing 
a  performance  criterion  over  the  class  of  fixed-order  controllers.  In  a  finite-dimensional  setting,  a 
set  of  necessary  conditions  in  the  form  of  four  coupled  matrix  equations  (as  a  direct  extension  of 
the  pair  of  the  separated  Riccati  equations  of  LQG  theory)  which  characterize  the  optimal  fixed- 
order  compensator  was  derived  in  [14].  These  four  equations  are  coupled  via  an  oblique  projection 
(idempotent)  matrix.  In  the  full-order  case,  this  projection  becomes  the  identity  thus  effectively 
eliminating  the  additional  two  equations,  and  the  necessary  conditions  reduce  to  the  standard  LQG 
Riccati  equations. 


The  notion  that  this  direct  (i.e.,  fixed-finite-order)  approach  can  be  applied  to  distributed 
parameter  systems  was  first  suggested  by  Johnson  in  [15]  and  further  developed  in  [16]  and  [17]. 
To  realize  such  an  approach,  however,  would  require  a  suitable  generalization  of  the  optimality 
conditions  for  the  finite-dimensional  fixed-order  theory.  This  result  was  subsequently  obtained  in 
[18]  where  the  matrix  optimal  projection  equations  obtained  in  [14]  for  finite-dimensional  systems 
were  extended  to  a  set  of  four  coupled  operator  Riccati  and  Lyapunov  equations  characterizing 
optimal  fixed-finite-order  controllers  for  infinite-dimensional  systems. 

In  developing  numerical  schemes  to  actually  compute  fixed-finite-order  compensators  for 
infinite-dimensional  systems,  one  might  consider  an  approach  wherein  LQG  reduction  procedures 
are  applied  to  a  sequence  of  controllers  obtained  by  using  finite-dimensional  full-order  design  tech¬ 
niques  in  conjunction  with  high-order  finite-dimensional  plant  approximations.  However,  such  an 
approach  is  unappealing  for  two  reasons.  First,  since  such  methods  are  not  predicated  on  the 
minimization  of  a  performance  index,  prospects  for  convergence  are  slim.  And,  second,  controller- 
reduction  methods  have  not  proven  to  be  reliable  in  producing  stabilizing  compensators  (see,  for 
example,  [13]). 

Hence,  on  the  other  hand,  we  develop  an  abstract  approximation  framework  (and  ultimately 
computational  schemes)  which  combine  the  infinite-dimensional  optimal  projection  theory  of  [18] 
with  the  approximation  ideas  developed  in  [9-12]  for  infinite-dimensional  LQG  problems.  More 
precisely,  our  approach  involves  constructing  a  sequence  of  approximating  finite-dimensional  sub¬ 
spaces  of  the  original,  underlying,  infinite-dimensional  Hilbert  state  space  along  with  correspond¬ 
ing  sequences  of  bounded  linear  operators  which  approximate  the  given  input,  output,  and  system 
operators.  Then,  by  choosing  bases  for  these  approximating  subspaces  and  applying  the  finite¬ 
dimensional  optimal  projection  theory,  a  sequence  of  matrix  equations  characterizing  a  sequence 
of  approximating  optimal,  fixed- finite-order  compensators  for  the  distributed  system  is  obtained. 
Finally,  numerical  techniques  for  solving  the  matrix  optimal  projection  equations  (for  example,  the 
homotopic  continuation  algorithm  described  in  [19]  and  [20])  can  be  used  to  compute  the  sequence 
of  approximating  gains. 

Our  primary  aim  in  this  paper  is  to  describe  the  general  approach  we  are  proposing,  to  discuss 
its  implementation,  and  to  demonstrate  its  feasibility  and  practicality.  We  offer  no  convergence 
arguments  here,  but  rather  reserve  them  for  a  more  theoretical  paper  to  follow.  Instead,  we  consider 
the  application  of  our  technique  to  two  examples.  One  involves  the  control  of  a  one-dimensional, 
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single-input,  single-output  parabolic  (heat/difiusion)  system  while  the  other  involves  a  single-input 
single-output  one-dimensional  hereditary  control  system.  These  relatively  simple  examples  have 
been  used  throughout  the  distributed  parameter  control  literature  to  illustrate  the  application  of 
new  theories  and  techniques.  A  detailed  discussion  of  the  application  of  our  ideas  to  more  complex 
control  systems,  for  instance,  the  vibration  control  of  flexible  structures,  will  also  appear  elsewhere. 
We  use  spline-  based  Ritz-Galerkin  finite  element  schemes  to  approximate  the  open-loop  systems 
(one  for  which  convergence  can  be  demonstrated  in  the  LQG  case)  and  present  and  discuss  some 
of  the  numerical  results  which  we  have  obtained  using  our  general  approximation  framework. 

We  now  outline  the  remainder  of  the  paper.  In  Section  2  we  briefly  review  the  infinite¬ 
dimensional  optimal  projection  theory  from  [18],  describe  the  approximation  framework,  and  derive 
the  corresponding  equivalent  matrix  equations  and  feedback  gains  which  characterize  the  approx¬ 
imating  fixed-finite-order  compensator.  In  Section  3  we  consider  the  examples,  construct  the  ap¬ 
proximation  schemes,  and  discuss  our  numerical  findings.  Section  4  contains  a  summary  and  some 
concluding  remarks. 

2.  Optimal  Projection  Theory  and  Finite-Dimensional  Approximation 

We  consider  the  following  fixed-finite-order  dynamic-compensation  problem.  Given  the  infinite¬ 
dimensional  control  system 

i(t)  =  Ax(t)  +  Bu(t)  +  Hiw{t)  (2.1) 

with  measurements 

V (0  =  Cx{t)  -I-  £Tju;(t),  (2.2) 

where  t  €  (0,oo),  design  a  finite-dimensional,  r»eth-order  dynamic  compensator 

MO  =  -AeMO  +  Bey{t),  (2.3) 

u(f)  =  Cexe{t)  (2.4) 

which  minimizes  the  steady-state  performance  criterion 

J(Ac,Bc,Ce)  =  Km  TE[{RlX(t),x(t))  +  u(t)TR2u(t)].  (2.5) 

For  convenience  we  denote  the  infinite-dimensional  plant  by  77 ;  that  is, 

H  =  {A,  B,C,  7?i,  72j,  Vj,  Vj). 
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Here  x(i)  lies  in  a  real,  separable  Hilbert  space  X  with  inner  product  (*,•),  A  :  Dom  (A)  C  X  — *  X  is 
a  closed,  densely  defined  operator  which  generates  a  C0  semigroup  {T(i)  :  t  >  0}  of  bounded  linear 
operators  on  X,B  €  £(21”*, X),  and  C  €  £(£,IR4).  We  assume  that  the  state  and  measurement 
are  corrupted  by  a  white  noise  signal  w(t)  in  a  real,  separable  Hilbert  space  X  (see  [21]  or  [22]), 
that  Hi  €  C(X ,  X),Hi  €  C{X,JRl),Ri  €  £(JT)  is  (self-adjoint)  nonnegative  definite,  and  that 
is  an  m  x  m  (symmetric)  positive-definite  matrix.  We  define  Vi  =  H\H{  and  Vj  =  H^H},  where 
(  )*  denotes  adjoint,  and  assume  for  convenience  that  Hi  =0  and  that  Vs  is  positive  definite. 
The  compensator  is  assumed  to  be  of  fixed,  finite  order  n„  (i.e.,  xe(t)  €  IRn*)  and  that  Ae,Bc, 
and  Ce  are  matrices  of  appropriate  dimension.  For  further  details  and  discussion  on  the  problem 
statement  and  the  above  assumptions,  see  [18]. 

We  summarize  here  the  primary  result  from  [18]  characterizing  optimal  fixed-finite-order  con¬ 
trollers.  For  convenience  define  E  =  BR^lB*  and  E  =  C*V3-1C.  Also  let  Jn.  and  Iz  denote 
respectively  the  ne  x  ne  identity  matrix  and  the  identity  operator  on  X . 


Theorem  2.1.  Let  ne  be  given  and  suppose  there  exists  a  controllable  and  observable  ncth- 
order  dynamic  compensator  ( Ae ,  Be,Ce)  which  minimizes  J  given  by  (2.5)  and  for  which  the  closed- 
loop  semigroup  generated  by 


A 

BeC 


BCe 

A* 


is  uniformly  exponentially  stable.  Then  there  exist  nonnegative-definite  operators  Q,P,Q,P  on  X 
such  that  Aei  Be,  and  Ce  are  given  by 


Ae  =  r{A-QE-EP)G\  (2.6) 

Be  =  TQC’Vj-1,  (2.7) 

Ce  =  -K;XB*PG',  (2.8) 

where  Q  :  Dom(A*)  -»  Dom(A),P  :  Dom(A)'->  Dom(A*),Q  :  X  — ►  Dom(A),P  :  X  -* 
Dom  (A*),  and  G,T  €  £(T,IRn*),  and  such  that  the  following  conditions  are  satisfied: 

rank  Q  =  rank  P  =  rank  QP  =  nc,  (2.9) 


QP  =  G*Aff,  PG*  =  /n#, 


(2.10) 


for  some  Af  6  IRn*x"*, 
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0  =  AQ  +  QAt  +  Vl-QZQ  +  T±Q2Qrl,  (2.11) 

0  =  A*P  +PA+Ri-  PSP  +  r‘±PEPr i,  (2.12) 

0  =  (A  -  EP)Q  +  Q(A  -  EPy  +  QSQ  -  r±Q2Qrl,  (2.13) 

0=  (A  -  QE)*P  +  P(A  -  QE)  +  PEP  -  r^PEPr x,  (2.14) 

where 


r  =  GT,  T±  =  Ir-  r. 

It  is  shown  in  [18]  that  the  factorization  (2.10)  for  the  nonnegative-definite  operators  Q  and  P 

A  A 

satisfying  rank  QP  =  ne  always  exists  and  is  unique  except  for  a  change  of  basis  in  IR”° .  It  is  also 
shown  in  [18]  that  T*  :  IRn<’  — ♦  Dom(A*)  so  that  the  expression  (2.6)  is  well  defined. 

Equations  (2.11)-(2.14)  are,  in  general,  infinite-dimensional  operator  equations.  To  actually  use 
them  to  compute  the  optimal  fixed-order  compensator,  a  finite-dimensional  plant  approximation  is 
required.  For  each  IV  =  1,2, .. .,  let  XN  denote  a  finite-dimensional  subspace  of  X  and  let  PN  : 
X  — »  XN  denote  the  corresponding  orthogonal  projection  of  X  onto  XN .  Let  AN  €  C{XN),BN  6 
C(lRm,XN),Cff  €  C{XN,1Rl),R f  €  £{XN),  and  Vf  €  C(XN).  We  consider  the  system  (2.6)- 
(2.14)  with  the  plant  77  replaced  by  the  plant  77 N  given  by 

nN  4  {AN ,BN ,CN ,R? ,R^V? ,Vt). 

Typically,  the  operators  BN ,CN ,  Rx  and  Vf*  are  chosen  as  BN  —  PN B,CN  =  CPN ,  R±  =  PN  Rx 
and  V”  =  PNVX  with  the  requirement  that  PN  converge  strongly  to  the  identity  7*  as  N  — ►  oo. 
The  operator  AN  is  chosen  so  that  it  and  its  adjoint  satisfy  the  hypotheses  of  the  Trotter-Kato 
semigroup  approximation  theorem  (i.e.,  stability  and  consistency,  see,  for  example,  [23]).  That  is, 
An  is  chosen  so  that  limjv_0O  TN(t)PN<f>  =  T(t)$,  and  lim^_00  TN(t)*PN<j>  =  uniformly 

in  t  for  t  in  bounded  intervals,  for  each  tf>  €  X,  where  TN(t)  =  exp(iA^),  t  >  0.  We  shall  say  more 
about  these  choices  for  AN ,  BN  ,CN ,  R^ ,  and  Vf*  when  we  address  convergence  questions  below. 

Although  with  the  plant  IIN  equations  (2.11)— (2.14)  are  finite  dimensional,  they  jure  still  oper¬ 
ator  equations.  It  is  their  matrix  equivalents  which  are  used  in  computations.  Unless  orthonormal 
bases  are  chosen  for  the  subspaces  X  N  (which  is  typically  not  the  case  in  practice)  some  care  must 
be  taken  to  obtain  the  appropriate  matrix  system. 
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For  each  N  =  1,2,-...,  let  be  a  basis  for  XN  and  choose  the  standard  bases  for  all 

Euclidean  spaces.  For  a  linear  operator  L  with  domain  and  range  XN  or  any  Euclidean  space, 
let  [ L]  denote  its  matrix  representation  with  respect  to  the  bases  chosen  above.  Also,  let 
denote  the  fc*-square  Gram  matrix  corresponding  to  the  basis  that  is,  =  (<f>^ , 

i,j  =  1, 2, . . . ,  kN .  Noting  that 

[(A*)*]  =  (<PJV)-1[AJV]T<PJV,  [(B*)’]  =  [2J*]T**,  [(C*)]  =  (0-1[G*]T, 

[Of  )*]  =  [£*]  =  [SJV]i?a~1{5JV]T^,  [£*]  =  (^JV)"1[CiV]TK3-l[CJV], 


the  matrix  equivalents  of  the  operator  equations  (2.11)-(2.14)  become 

o  =  [a*][q*]  +  [gjV](^)~1[AJV]T^  +  [vn  -  [QN][r*][Q*] 

+  [tf  -  {*Nrl[TZ\r** ,  (2.15) 

0  =  (4>JV)-1[AiV]T<PJV(PJV]  +  IP*]  -  (A*]  +  (**]  -  [P*][r*][P*] 

+  (^)-i[r*]T4>*[P*j  -  (r*][P*](if  ],  (2.16) 

0  =  {[*"}  -  [r*][p*])[Q*]  +  [g^K^j-^lA*]  -  [i;w][Pw])T$JV 

+  [$*][£"][<?*]  -  (i-xlW^K^KQ^K^)-1  -  [rJT**,  (2.17) 

o  =  (#*)-*  ([a*]  -  \qn  Hi;*])  V[p*]  +  [p^KIa*]  -  [Q^p*]) 

+  [P^p^P*]  -  (^J-^rfj^fP^jtr^HP^Hr^].  (2.18) 


Therefore,  if  we  define  the  kN  x  kN  nonnegative-definite  matrices 

Qf  =  [Q^K**)-1,  P?  =  **[/>*], 
QS  =  [Q"  HO'1.  p0n  =  *n[p% 

Vo"  =  [V*](^)-1,  Rg  4  #*[*?], 


Eg  =  £?  =  [cAr]Tva-1[cJV], 

we  can  solve  the  matrix  optimal  projection  equations  given  in  [14]  corresponding  to  the  matrix 
plant  model 

ng  =  {[A*],[p*i,[c*],ii5r,i?>,v'0*,va}, 

to  obtain  the  matrices  Qq  ,Pq  ,Q%  and  Pf.  The  approximating  optimal  neth-order  dynamic 
compensator  {A*,B*,C*  }  is  then  given  by 

A*  =  p0*([a*]  -  (flu?  -  Effeff){pff)\ 

Bff  =  r0*gSr[c*]Tvi-1, 

cff  =  -f^MsT^GST, 
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where  r?,Gg  €  IR"'***,  and  M"  €  IRn*xn*  satisfy 

QgPo”  =  G^MNr^  rg(p%)r  =  , 

n = (G»rr0N,  {t*} = ik„  -  [r^]. 

When  an  infinite-dimensional  controller  will  suffice,  Ce  =  —  R^1  B‘ P  €  £(X,IRm)  and  Bc  = 
QC,V{~1  €  £(/Z4,  JC)  are  the  usual  infinite-dimensional  LQG  controller  and  observer  gains  (see  [9]). 
The  operators  P,Q  €  L{X)  are  the  nonnegative-definite  solutions  to  the  two  decoupled  operator 
algebraic  Riccati  equations  (2.11)  and  (2.12)  with  r  and  r±  formally  set  to  lx  and  0,  respectively. 
Since  Ce  has  range  in  IRm  and  Be  has  domain  IR4,  there  exist  vectors  ce  =  (cj, . . .  ,c™)T  £  xyLx.T 
and  be  =  (&J, . . .  ,64)T  €  *j=1X  such  that 

[Cex]i  =  <c‘,  x),  1*1,2 . .  xeX, 

and 

t 

Bey  =  bJy  =  Y^yiK,  y  =  (yx,  -  »y«)  e  ir4. 

«=i 

The  vectors  ce  and  be  are  referred  to  as  the  optimal  LQG  controller  and  observer  functional  gains 
respectively. 

With  regard  to  approximation  for  the  full-order  LQG  problem,  for  each  N  =  1,2, . . .  we  take 
ne  =  kN .  Then  it  is  not  difficult  to  show  that 

C?\PNx]  =  <c",  z>,  XEX, 

and 

B?y  =  (*")Ty,  y€lR4, 

where  c*  €  x^I^  and  6*  €  x^=1XN  are  given  by  cf  =  C? {$N)~l<t>N  and  b%  =  (B?)T<j>N 
respectively  with  <bN  —  {4>\t  ■  ■  •  >^$0  £  The  vectors  and  are  referred  to  as  the 

approximating  optimal  LQG  controller  and  observer  functional  gains.  To  compute  them  we  need 
only  solve  two  standard  decoupled  matrix  algebraic  Riccati  equations  for  the  kN  x  kN  nonnegative- 
definite  matrices  Qtf  and  Pq  . 

A  rather  complete  convergence  theory  for  LQG  approximation  can  be  found  in  [9] .  Essentially, 
it  is  shown  there  that  if  the  approximating  subspaces  XN  are  chosen  so  that  the  projections  PN 
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converge  strongly  to  the  identity  as  N  — »  oo,  the  operators  AN ,BN ,CN ,R^  ,  and  are  chosen 
as  was  described  above,  and  the  operators  QN  and  PN  are  uniformly  bounded  in  TV,  then  QN  and 
PN  converge  weakly  to  Q  and  P,  respectively  as  N  — ►  oo.  This  in  turn  implies  that  C?  — »  Cc, 
strongly,  B?  — ►  Be,  weakly,  — »  ce  and  b?  — *•  ie,  weakly,  and  the  closed-loop  semigroup 
for  the  approximating  optimal  LQG  compensator  converges  weakly  to  the  closed-loop  semigroup 
for  the  optimal  infinite-dimensional  LQG  compensator,  as  N  — *  oo.  If,  in  addition,  the  operators 
SN(t)  =  TiV(t)+BJVCjv  and  5^(4)  =  TN[t)-B^CN  are  uniformly  exponentially  stable,  uniformly 
in  N,  then  QN  — »  Q  and  PN  — »  P,  strongly,  C -*  Ce  and  B %  — ♦  Bc,  in  norm,  cf  — »  cc  and 

6 %  — »  6e,  strongly,  and  the  closed-loop  semigroups  converge  strongly,  as  N  — »  oo.  If  7?^  and 
are  coercive,  uniformly  in  iV,  then  SN(t)  and  SN(t)  will  be  uniformly  exponentially  stable.  If  it  is 
also  true  that  Ri  and  Vj  are  trace  class  and  PN  —*  Ri  and  Vj N PN  — ♦  V\  in  trace  norm  then  Q 
and  P  are  trace  class  and  QN PN  — *  Q  and  PN  PN  — »  P  in  trace  norm  as  N  — *  oo. 


Returning  to  the  fixed-finite-order  case,  we  note  that  in  general  the  approximating  optimal 
projection  equations  may  not  possess  a  unique  solution.  However,  in  [19]  it  is  shown  for  the  finite¬ 
dimensional  case  that  it  is  possible  to  obtain  an  upper  bound  for  the  number  of  stabilizing  solutions. 
Using  topological  degree  theory,  the  following  result  was  obtained  in  [19]. 


Theorem  2.2.  Consider  the  equations  (2.1l)-(2.14)  with  the  infinite-dimensional  plant  77  re¬ 
placed  by  the  finite-dimensional  plant  II N .  Let  nu  denote  the  dimension  of  the  unstable  subspace  of 
An  and  assume  that  ne  >  nu.  Then  in  the  class  of  nonnegative-definite  operators  QN ,  PN ,QN ,  PN 
on  XN  satisfying  rank  QN  =  rank  PN  =  rank  QN PN  =  ne,  there  exist  at  most 

( min(fciV, m, t)  -  nu\  .  N 

),  ne  <  minfk  ,  m,  £), 

\  nc  nu  / 


1,  otherwise, 

solutions  of  (2.11)-(2.14),  each  of  which  is  stabilizing.  If,  in  addition,  the  plant  [AN ,  BN ,CN) 
is  stabilizable  by  an  nefb-order  ^'.ntroller,  then  there  exists  at  least  one  stabilizing  solution  of 


(2-9)— (2.14). 


Theorem  2.2  shows  that  while  there  may  exist  multiple  solutions  to  the  finite-dimensional  op¬ 
timal  projection  equations,  in  practice  this  number  can  be  quite  small.  For  example,  if  ne  >  nu 
and  the  system  is  either  single  input  (m  =  1)  or  single  output  (£  =  1)  then  there  exists  at  most 
one  solution  to  (2.9)-(2.14)  for  the  plant  IIN .  The  existence  of  at  least  one  stabilizing  solu¬ 
tion  of  course  depends  upon  whe*\  r-  or  not  the  plant  is  stabilizable  by  an  ncth-order  controller 
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(for  relevant  results,  see  [24]).  Finally,  while  it  may  be  possible  to  stabilize  a  plant  with  ne  <  nu, 
this  case  lies  outside  the  scope  of  the  analysis  given  in  [19]. 


3.  Examples  and  Numerical  Results 


We  first  consider  the  one-dimensional,  single-input/  single-output,  parabolic  (heat /diffusion) 
control  system  with  Dirichlet  boundary  conditions  given  by 


dv  c^v 

■~{t,ri)  =  a~(t,ri)  +  b(r))u(t)  +  hi(ri)wl(t,T)),  0  <  rj  <  1,  t  >  0, 

v(t,0)  =  0,  v(t,l)  =  0,  t>  0, 

y(*)  =  f  e(n)v(t,ri)dTt  +  h2w2{t),  t  >  0, 

Jo 

where  a  >  0,  and  &(•)  and  c(-)  are  given  by 


Hv) 


and 


c(>?) 


H 

r _ _ 

—  J  Tt — n  ’ 

U 


elsewhere, 


(3.1) 

(3.2) 

(3.3) 


Tfi  <n<  72, 

elsewhere, 

with  0  <  pi  <  fi2  <  1  and  0  <  71  <  73  <  1.  In  (3.1)  and  (3.3),  h(-)  G  ioo(0, 1),  u>i(t,  •)  G 
£2(0,  l),o.a.  t  G  [0,oo),  (see  [22],  p.  314),  h2  is  a  nonzero  constant  and  u/2(-)  is  unit-intensity  white 
noise. 


To  rewrite  (3.1)-(3.3)  in  the  form  (2.1),  (2.2),  in  the  usual  way  we  take  X  =  L2( 0, 1)  endowed 
with  the  standard  L2  inner  product,  let  x(t)  =  >  0,  define  A  :  Dom(A)  c  X  — *  X  by 

A<j>  =  aD2<t>  for  <f>  G  Dorn  A  =  #*(0, 1)  n  H^(0, 1),  and  define  B  G  ^(IR1,  X)  and  C  G  C{X  .IR1)  by 
Bu  =  6(-)u  for  u  G  IR1,  and  —  Jq  c{r))  4>{t])dr),  for  <j>  G  L2(0, 1),  respectively.  Furthermore,  let 
X  =  ij(0,l)  x  IR,  set  w(t)  =  (u»i(t,  •),  w2(t))  G  X ,  and  define  if  1  G  £(X,X)  and  H2  G  ^(X^IR1) 
by  H\z  =  Ai(-)zi  and  H2z  =  h2z2  for  z  —  (zi,z2)  G  £. 

It  is  well  known  (see,  for  example,  [23])  that  A  is  closed,  densely  defined,  and  negative  definite. 
Furthermore,  A  is  the  infinitesimal  generator  of  a  uniformly  exponentially  stable,  analytic  (abstract 
parabolic)  semigroup  {T(t)  :  t  >  0}  of  bounded,  self-adjoint  linear  operators  on  X . 

We  consider  linear  spline-based  Ritz-Galerkin  approximation  for  the  open-loop  system.  For 
each  N  =  2,3, . . .,  let  be  the  linear  spline  (“hat”)  functions  defined  on  the  interval  [0,1] 
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with  respect  to  the  uniform  partition  {0, ,  1},  i.e., 

Ntj-j+1,  »?€[*^;£), 

<t>}  (*?)  =  j  +  1-  Nr{,  r)  €  [^-,  ^), 

.  0,  elsewhere  on  [0,1], 

j  =  1,2,. ..,1V  —  1.  Set  =  span^*}^1  and  note  that  kN  =  dimX^  =  N  —  1,  and 

C  £To(0, 1)  for  all  JV.  If  ^  :  J  — *  denotes  the  orthogonal  projection  of  X  onto  XN , 
then  standard  convergence  estimates  for  interpolator  splines  (see  [25])  can  be  used  to  show  that 
lhnjv-.oo  PN<t>  —  <k  in  Lj(0, 1)  for  <f>  6  Zr3(0, 1). 

There  are  two  equivalent  ways  to  obtain  an  operator  representation  for  the  usual  Ritz-Galerkin 
approximation  to  A.  First,  A  can  be  extended  to  a  bounded  linear  operator  from  Hq  (0, 1)  onto  its 
dual,  ff-1(0, 1),  via 

(A*)M  =  -a(D<f>,D^),  Me  F0l(0,l)-  (3-4) 

Since  XN  C  floMO.l)  for  all  N  =  2,3,...,  we  define  AN  6  Z{XN)  by  AN <f>N  =  A<f>N ,<j>N  €  XN, 
with  A<f>N  €  H~i{ 0, 1)  considered  to  be  a  linear  functional  on  XN .  From  the  Riesz  Representation 
theorem  we  obtain  AN <f>N  —  ipN  where  i})N  is  that  element  in  XN  which  satisfies  {AN <j>N)(xN)  = 

—a(D<frN  tDxN)  —  <V'JV»XJV)* 

Alternatively  and  equivalently,  by  using  the  fact  that  A  is  self-adjoint,  we  can  define  AN  as 
follows.  Let  P{*  :  27q(0,  1)  —*  XN  denote  the  orthogonal  projection  of  the  Hilbert  space  Hq(0,  1) 
onto  XN.  Using  the  definition  (3.4),  it  is  not  difficult  to  show  that  -A  €  £(ffo(0,  l),ff~1(0, 1)) 
is  coercive  and,  therefore,  that  A-1  :  H~1{ 0,1)  — ♦  Hq  (0, 1)  exists  and  is  bounded.  We  then  define 
An  €  C(XN)  to  be  the  inverse  of  the  operator  given  by  (A^)-1  =  Pf  A-1  • 

Using  either  definition,  it  is  easily  argued  that  AN  is  well  defined,  self-adjoint,  and  is  the 
infinitesimal  generator  of  a  uniformly  exponentially  stable  (uniformly  in  N)  semigroup,  TN(t)  = 
exp (tAN),t  >  0,  of  bounded  linear  operators  on  XN .  Also,  using  the  approximation  properties  of 
splines,  it  is  not  difficult  to  show  that  lim;y_oo(A;v)~1.PJv^  =  A-1^,^  €  X.  Consequently,  the 
hypotheses  of  the  TYotter-Kato  theorem  (see  [23])  are  satisfied  and  we  have  limjv-»oo  TN(t)PN <f>  = 
T(t)<j>  and  Iim^_00  TN  {t)*  PN  <t>  =  T(t)'<f>,<f>  €  X ,  uniformly  in  t  for  t  in  bounded  intervals.  A 
detailed  discussion  of  the  results  just  outlined  can  be  found  in  [8]. 

We  define  BN  —  PN B  and  CN  =  CPN ,  from  which  it  immediately  follows  that  lim;v_00  BN  — 
B  and  lim^_oo  CN  =  C  in  norm  and  similarly  for  their  adjoints.  For  the  example  we  shall  consider 


here,  we  have  chosen  iii  =  rj/x./Jj  =  r2/m,  with  rj,rj  >  0.  Setting  hi{rj)  =  vf  ,0  <  rj  <  1,  and 
hj  =  with  t>i,vj  >  0,  we  obtain  Vl  —  vxIx  and  Vj  =  v3.  We  then  take  R±  =  and 

Vf*  =  PNVi.  For  the  LQG  problem,  the  open-loop  uniform  exponential  stability  of  both  the 
infinite-dimensional  system  and  the  approximating  systems  is  sufficient  to  conclude  the  strong 
convergence  of  the  approximating  Riccati  operators  to  the  solutions  of  the  infinite-dimensional 
Riccati  equations,  the  uniform  norm  convergence  of  the  approximating  controller  and  observer 
gains,  and  the  strong  convergence  of  the  functional  gains,  as  N  — ►  oo. 

Since  the  basis  elements  are  piecewise  linear  with  respect  to  the  uniform  mesh 

on  [0,1],  the  equivalent  matrix  representations  for  the  operators  defined  above  can 
be  computed  directly  and  in  closed  form.  The  Gram  matrix  =  1,2, . . . ,  N  -  1 

is  given  by  =  ^Tridiag{^,  |,  ^},  and  if  we  define  the  generalized  stiffness  matrix  &N  by 
!?£  =  -a(D<l>?,D<f>?),iJ  =  lf2,...,N  -  1,  then  =  aN  Tridiag{l, -2, l}.  It  follows  that 
{AiV]  =  [<?"]  =  with  6?  =  (b,<f>?)  =  tfWdr,,  and 

c?  =  <c,^>  =  <t>?{r))dr),i  =  1,2, . . . ,  N- 1,  and  that  Rtf  =  r^N  and  V0N  =  vi(^N)~l. 

For  our  numerical  study  we  set  a  =  1 , 0i  =  .75  -  .03i/2,  Pi  =  75+ .04\/2, 7i  =  .25  -  .04 v^,  7j  = 
.25  +  .03 y/2tri  =  vi  =  l,r2  =  t/a  =  10-4,.Ai(ij)  s  1,  and  used  our  technique  to  compute  approxi¬ 
mating  optimal  LQG  (i.e.,  ne  =  N  -  1)  amd  1st  order  (i.e.,  ne  =  1)  compensators  for  various  values 
of  N.  The  open-loop  stability  of  system  (3.1)-(3.3)  and  the  approximating  systems  imply  that  the 
finite-dimensional  approximating  optimal  projection  equations  have  a  solution.  Theorem  2.2  on  the 
other  hand,  with  nu  =  0  aind  nc  =  1  or  ne  =  N  —  1,  implies  that  they  have  at  most  one  solution. 
Consequently,  the  system  of  equations  (2.11)-(2.14)  with  the  plants  IJN  admits  a  unique  solution. 

The  optimal  projection  equations  (2.11)-(2.14)  were  solved  using  the  homotopic  continuation 
algorithm  described  in  [19].  It  is  shown  in  [19]  that  the  operation  count  for  the  algorithm  is 
proportional  to  p(2n8  -(-  (m  +  l)n2  +  (m  +  £)sn8)  where  p  is  the  number  of  integration  steps  and  n 
is  the  dimension  of  the  finite-dimensional  plant.  This  is  competitive  with  the  operation  count  for 
the  Hamiltonian  solution  of  the  standard  Riccati  equations  which  is  0(l6n3)  for  LQG.  Also,  note 
that  the  computational  burden  for  the  solution  of  the  optimal  projection  equations  decreases  with 
n«- 

Since  m  =  l  =  1  in  the  LQG  case,  the  optimal  functional  observer  and  feedback  control  gains 
be  and  ce  and  the  approximating  gains  and  c? ,  are  all  simply  Li  functions  with  b?  and 
elements  in  XN .  We  plot  the  functions  b1^  and  we  obtained  for  various  values  of  N  respectively 
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REGULATOR  FUNCTIONAL  GAI 


In  the  fixed-order  case  with  ne  =  1,  the  compensator  gains  Ae,Bc,  and  Ce  are  all  scalars.  Also, 
for  a  first-order  controller  there  are  only  two  independent  parameters,  Ae  and  BeCc.  In  Table  3.1 
below  we  give  the  values  we  obtained  for  A?  and.B^C^  for  various  values  of  N.  Once  again, 
it  is  clear  that  the  gains  are  converging  as  N  increases.  In  addition,  in  Table  3.1  we  provide  the 
closed-loop  costs  Jlqq  and  JpQ  for  the  LQG  and  first-order  controllers.  These  closed-loop  costs 
were  evaluated  using  a  64th-order  modal  approximation  to  the  infinite-dimensional  system.  For  all 
values  of  N  the  performance  of  the  fixed-order  compensator  was  within  2%  of  the  corresponding 
LQG  controller.  Thus,  for  example,  the  replacement  of  a  32nd-order  approximating  optimal  LQG 
controller  by  an  approximating  optimal  first-order  controller  will  yield  considerable  implementation 
simplification  with  only  minor  performance  degradation.  Note  that  for  the  example  we  consider 
here,  it  is  possible  to  compute  the  open-loop  cost  for  the  infinite-dimensional  system  in  closed  form. 

We  have  ^ 

Jot  =  tr  ViT*  (t)fliT(i)dt  =  urrjtr  [  T(t)2dt 
Jo  Jo 


=  Vlfl 


OO  /»0O  00  1 

V'  f  0-2na**at  _  tflrl  V'  _L 


“  ~  Tn  ^  °8333- 
12a  12 


Finally,  for  comparison  purposes,  we  tried  applying  balancing  techniques  to  the  LQG  controllers 
to  reduce  their  order.  However,  with  ne  =  1,  such  controllers  were  found  to  be  destabilizing.  Based 
upon  the  results  in  [13],  this  was  not  unexpected. 


N 

B?C? 

Jlqo 

J$o 

4 

-687.6 

5470 

.06999 

.07014 

8 

-720.9 

5231 

.06870 

.06993 

12 

-730.9 

5182 

.06872 

.06991 

16 

-734.3 

5145 

.06874 

.06990 

20 

-738.0 

5127 

.06875 

.06990 

24 

-737.6 

5108 

.06876 

.06990 

28 

-739.8 

5109 

.06876 

.06990 

32 

-738.7 

5099 

.06877 

.06990 

Table  3.1 
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As  a  second  example  we  consider  the  one-dimensional,  single-input,  single-output  hereditary 
control  system  given  by 

v(t)  =  aov(t)  +aiv(t  -  p)  4-  b0u(t)  +  h1w(t),  t  >  0,  (3.5) 

y(t)  =  c0v(t )  +  haw(t),  t  >  0,  (3.6) 

where  ao%ii,bo,CQ,hitha,p  €  IR1  with  Aj  ^  0,  and  w  is  a  unit-intensity  white  noise  process.  To 
rewrite  (3.5),  (3.6)  in  the  form  (2.1),  (2.2),  we  take  X  =  IR1  x  L2(-p, 0)  endowed  with  the  usual 
product  space  inner  product,  {(»?,$),(£,  VO)  =  V'V'j  and  let  x(t)  =  (v(t),vt),  t  >  0,  where 

for  t>0,vte  L2(-p,0)  is  given  by  vt($)  =  u(i  +  0),  -p  <0  <  0.  Define  A:  Dom(A)  C  X  — ►  X  by 
A*  =  (o0*(0)  +  ai<t>(—p),  D<f>)  for  $  =  (*(0),rf)  €  Dom(A)  =  {(£,  VO  €  X  €  H\-p,0),  V>(0)  = 
£},  and  let  B  €  ^(IR^X)  and  C  €  ,£(.£, IR1)  be  given  by  Bu  =  (5o«>0)  and  C(rj,<f> )  =  c0n, 
respectively.  Let  X  =  IR1  and  define  Hi  €  £{i,X)  and  Ha  €  ^(X.IR1)  by  Hiz  =  (hiz,0)  and 
Haz  =  haz ,  for  z  6  IR1. 

The  operator  A  is  densely  defined  and  is  the  infinitesimal  generator  of  a  Co  semigroup  {T(t):  t  > 
0}  of  bounded  linear  operators  on  X  with  T(t)(rjt<f>)  =  (t>(t;  rj,  <£),  vt(r;,<^)),  t  >  0,  where  v{-\ri,<j>) 
is  the  unique  solution  to  (3.5)  with  b0  =  =  0.  and  initial  conditions  v(0)  =  rj,v0  =  <f>.  We  take 

Ri  €  £(X)  and  f?2  €  ^(IR1)  to  be  i?i(f?,^)  =  (ri»j,0)  and  /?2u  =  r2u,  respectively,  with  rltra  >  0. 
The  definitions  of  Hi  and  Ha  given  above  imply  that  V2  €  £(X)  and  V2  €  £(IR1)  are  given  by 
Vi(t\,<£)  =  (Ajij.O)  and  V2z  =  A|z,  for  (q,^)  €  X  and  r  €  IR1. 

We  employ  an  approximation  scheme  recently  proposed  by  Ito  and  Kappel  in  [26],  We  briefly 
outline  it  here;  a  more  detailed  discussion  can  be  found  in  [26].  For  each  N  =  1,2, . . .  let  € 
£*(-/»,  0)  denote  the  characteristic  function  for  the  interval  [—jp/N,  -{j  - 1  )p/N),j  =  1, 2, . . . ,  N, 
and  let  XN  be  the  ( N  +•  l)-dimensional  subspace  of  X  defined  by 

Xs  =  span{(l,0),(0,Xir) . (0,x£)}- 

Let  PN :  X  —*  Xn  denote  the  orthogonal  projection  of  X  onto  XN .  Let  {<f>^}^=0  denote  the  linear  B- 

spline  functions  defined  on  the  interval  [-p,  0]  with  respect  to  the  uniform  mesh  \-p . - p/N,0 }, 

and  set  X?  =  span{(^(0),<^)}*=0.  Then  X*  is  an  (IV  +  l)-dimensionaI  subspace  of  Dom(A) 
and  it  is  not  difficult  to  demonstrate  that  the  restriction  of  PN  to  X^  is  a  bijection  onto  XN .  Using 
the  fact  that  A  restricted  to  X^  has  range  in  XN ,  we  define  AN  €  C(XN)  by  AN  =  A(PIt)~l, 
and  set  TN{t)  =  exp(AJvt),  t  >  0.  Noting  that  f?(B)  C  X*,  we  take  BN  €  ^(IR^X*)  to  be  given 
by  BN  =  B.  Similarly,  we  take  R±  =  Ri  and  VS*  =  Vi.  We  set  CN  =  C. 


It  ia  shown  in  [26]  that  PN{r\,<f>)  -  in,*),  TN{t)PN(rit<f>)  -»  T{t){r,,4>),  and 

Tlf(t)*PN(ri,4>)  —*  T(t)*(fj,^)  for  (r),4>)  €  X  as  N  — *  oo,  uniformly  in  t ,  for  t  in  bounded  subsets 
of  [0,oo).  It  then  follows  that  limjv-Kjo  BN  =  B  and  limjv_oo  CN PN  =  C,  in  norm. 

For  the  LQG  (full-order)  problem,  the  optimal  functional  observer  and  feedback  control  gains 
be  and  ce  are  of  the  form  bc  =  {0o,0i)  and  ce  =  (7o>7i)  with  0oj~1o  €  IR1,  and  £1,71  €  £2(-p,0). 
The  approximating  gains  are  of  the  form  b?  =  (0q  ,0?)  and  =  (7^,7^)  with  0q  ,7$  £  IR1  and 
Pit'll  e  span  Since  we  are  treating  a  one-dimensional  example,  if  60  ^  0,  the  theory 

in  [26]  implies  that  0q  — » £0  and  7^  — ►  70  in  IR1,  and  0%  —*  0\ ,  and  7^  — ♦  71  in  Li(-p,0),  a3 
N  — ♦  00.  \ 

Once  again,  as  in  the  first  example,  matrix  representations  for  the  operators  AN ,  BN ,  CN ,  , 

and  Vf  are  not  difficult  to  compute  in  closed  form.  Indeed,  the  (N  +  1)  x  (N  +  1)  matrix  repre¬ 
sentation  for  the  bijection  PN:  Xf*  — ►  Xi  is  given  by 

1  0  0 
*  i  0 
0  *  i  0 

0  i  *  0 

0  0  *  * 

Then  [Aw]  =  where 


We  set  oo  =  ai  =  60  =  Co  =  ri  =  Ai  =  p  =  1,  r2  =  .1,  and  hi  =  \Cl  and  computed 
approximating  optimal  LQG  (i.e.,  ne  =  IV  +  1)  and  first-order  (i.e.,  ne  =  1)  compensators  for 
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N  —  8, 16,24,  and  32.  The  optimal  LQG  observer  gains  are  given  in  Table  3.3  and  Figure  3.3;  the 
control  gains  are  given  in  Table  3.4  and  Figure  3.4.  The  first  23  open-loop  poles  of  the  system 
(see  [27])  are  given  in  Table  3.2.  The  approximating  first-order  compensator  gains  along  with  the 
corresponding  and  LQG  closed-loop  costs  are  given  in  Table  3.5  below.  These  costs  were  computed 
using  an  evaluation  model  obtained  by  setting  N  =  64..  Note  that  the  performance  of  the  first- 
order  controllers  is  within  10%  of  the  performance  of  the  LQG  controllers.  Once  again  it  is  clear 
that  convergence  is  achieved. 


1.278465 

-1.588317  ±  4. 155305 i 
-2.417631  ±  10.68603i 
-2.861502  ±  17.0561  li 
-3.167754  ±  23.38538i 
-3.401945  ±  29.69798i 
-3.591627  ±  36.00146i 
-3.751047  ±  42.29965i 
-3.888543  ±  48.59442i 
-4.009422  ±  54.88686i 
-4.117267  ±  61.17761i 
-4.214618  ±  67.46710i 


Table  3.2 
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Table  3.3 


I 


WHY  COORDINATE 
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i 

....  g 

< 

..  3 


••  -O.T  •«.«  -0.4  .«.• 


Figure  3.4 


N 

8 

16 

24 

32 

7o" 

-4.4213 

-4.4229 

-4.4233 

-4.4234 

Table  3.4 
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N 

B?C? 

Jlqq 

Jfo 

8 

-4.835 

-16.057 

1.4042 

1.5221 

16 

-4.936 

-16.343 

1.403877 

1.5298 

24 

-4.959 

-16.378 

1.403856 

1.5309 

32 

-4.962 

-16.404 

1.403852 

1.5317 

Table  3.5 


4.  Summary  and  Concluding  Remarks 

We  have  proposed  an  approximation  technique  for  computing  optimal  fixed-order  compensators 
for  distributed  parameter  systems.  Our  approach  involves  using  the  optimal  projection  theory  for 
infinite-dimensional  systems  (which  characterizes  the  optimal  fixed-order  compensator)  developed 
in  [18]  in  conjunction  with  finite-dimensional  approximation  of  the  infinite-dimensional  plant.  We 
demonstrated  the  feasibility  of  our  approach  with  two  examples  wherein  we  used  spline-based  Ritz- 
Galerkin  finite  element  schemes  to  compute  approximating  optimal  first-order  controllers  for  one¬ 
dimensional,  singe-input /output,  parabolic  (heat/diffusion)  and  hereditary  control  systems.  Our 
numerical  studies  indicate  that  convergence  of  the  compensator  gains  is  achieved  and  that  using 
the  first-order  controller  would  lead  to  only  minimal  performance  degradation  over  a  standard  LQG 
compensator  while  yielding  significant  implementation  simplification. 

At  this  point  one  is  led  naturally  to  ask  the  question  of  whether  or  not  a  satisfactory  convergence 
theory  could  be  developed.  We  are  working  on  this  at  present  and  expect  that  such  a  theory 
would  conform  closely  in  form  and  spirit  to  the  convergence  results  for  LQG  approximation  found 
in  [9]  and  [10]  and  outlined  in  Section  2  above.  We  also  intend  to  consider  our  approximation 
ideas  in  the  context  of  discrete-time  or  sampled-data  systems,  and  for  continuous-time  systems 
involving  unbounded  input  and/or  output  (for  example,  boundary  control  systems),  and  systems 
with  control  or  measurement  delays,  see  [11], [12]).  Finally,  we  intend  to  investigate  the  application 
of  our  approximation  framework  to  other  infinite-dimensional  control  systems,  in  particular  the 
vibration  control  of  flexible  structures  (i.e.,  second-order  systems  such  as  wave,  beam,  or  plate 
equations). 
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Sequential  design  of  decentralized  dynamic  compensators  using  the 
optimal  projection  equations 

DENNIS  S.  BERNSTEINt 

The  optimal  projection  equations  for  quadratically  optimal  centralized  fixed-order 
dynamic  compensation  are  generalized  to  the  case  in  which  the  dynamic  com¬ 
pensator  has,  in  addition,  a  fixed  decentralized  structure.  Under  a  stabilizability 
assumption  for  the  particular  feedback  configuration,  the  resulting  optimality 
conditions  explicitly  characterize  each  subcontrolier  in  terms  of  the  plant  and 
remaining  subcontrollers.  This  characterization  associates  an  oblique  projection 
with  each  subcontroller  and  suggests  an  iterative  sequential  design  algorithm.  The 
results  are  applied  to  an  interconnected  flexible  beam  example. 


1.  Introduction 

The  purpose  of  this  note  is  to  consider  the  problem  of  designing  decentralized 
dynamic  feedback  controllers  using  recently  obtained  results  on  quadratically  optimal 
fixed-order  dynamic  compensation  (Hyland  and  Bernstein  1984).  As  in  Bernussou 
and  Titli  ( 1982).  Looze  et  al.  ( 1978),  and  Singh  ( 1981),  the  overall  approach  is  to  fix  the 
structure  (information  pattern  and  order)  of  the  linear  controller  and  optimize  the 
steady-state  regulation  cost  with  respect  to  the  controller  parameters.  The  underlying 
philosophy  is  that  the  ability  to  carry  out  such  an  optimization  procedure  permits  the 
evaluation  of  a  particular  decentralized  configuration  which  may  be  dictated  by 
implementation  constraints.  If  there  is  some  flexibility  in  designing  the  decentralized 
architecture,  then  these  results  can  be  used  to  evaluate  the  optimal  performance  of 
each  permissible  configuration,  and  hence  to  determine  preferable  structures.  Since 
the  present  paper  is  confined  to  the  question  of  optimal  regulation,  trade-offs  with 
rt  ard  to  robustness  in  the  presence  of  plant  variations  are  not  considered.  Such 
trade-offs  can  be  included,  however,  by  utilizing  the  Stratonovich  multiplicative  white 
noise  approach  developed  by  Bernstein  and  Hyland  (1985). 

To  further  motivate  our  approach,  consider  the  problem  of  controlling  an  nth- 
order  plant  #  by  means  of  a  decentralized  dynamic  compensator  consisting  of 
subcontrollers  and  e€1.  A  straightforward  design  technique  that  immediately 
comes  to  mind  is  that  of  sequential  optimization  (Davison  and  Gesing  1979,  Jamshidi 
1983).  To  begin,  ignore  tf2  and  design  as  a  centralized  controller  for  Next, 
regard  the  closed-loop  system  consisting  of  &  and  as  an  augmented  system  2P  and 

design  #2  as  a  centralized  controller  for  & .  Now  redesign  to  be  a  centralized 
controller  for  the  augmented  closed-loop  system  composed  of  &  and  #2,  and  so  forth. 
One  difficulty  with  this  scheme,  however,  is  that  of  dimension.  If,  for  example,  one  were 
to  employ  LQG  at  each  step  of  this  algorithm,  then  on  the  first  iteration  would 
have  dimension  n  and  thus  # 2  would  have  dimension  2n.  On  the  second  iteration, 
would  require  dimension  3 n  and  # 2  would  have  order  4n,  and  so  forth.  Such 
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difficulties  can  be  avoided  by  setting  n  =  0,  which  essentially  corresponds  to  static 
output  feedback.  Although  easier  to  implement,  static  output  feedback  iacks  filtering 
abilities  such  as  are  inherent  in  LQG  controllers,  which  are  purely  dynamic  (i.e.  strictly 
proper). 

As  discussed  by  Sandell  et  al.  (1978),  p.  119,  the  explanation  for  this  difficulty  is 
provided  by  the  ‘second-guessing’  phenomenon:  when  LQG  is  used,  each  subcon¬ 
troller  must  consist  of  linear  feedback,  not  only  of  estimates  of  the  plant  states  but  also 
of  estimates  of  the  other  subcontrollers  ’  estimates.  Hence  the  ‘optimal’  controller  is 
given  by  an  irrational  transfer  function,  i.e.  a  distributed  parameter  (infinite¬ 
dimensional)  system.  Such  controllers,  of  course,  must  be  ruled  out  since  their  design 
and  implementation  (except  in  special  cases)  violate  physical  realizability  (see,  for 
example,  Bernstein  and  Hyland  1986). 

Having  thus  ruled  out  zeroth-order  and  infinite-order  decentralized  controllers, 
we  focus  on  the  problem  of  designing  purely  dynamic  decentralized  compensators. 
Moreover,  by  invoking  the  constraint  of  fixed  subcontroller  order,  we  overcome  the 
second-guessing  phenomenon.  Utilizing  the  parameter  optimization  approach  thus 
leads  to  a  generalization  of  the  result  obtained  by  Hyland  and  Bernstein  (1984)  for 
centralized  control.  In  brief,  it  was  shown  in  Hyland  and  Bernstein  (1984)  that  the 
unwieldy  first-order  necessary  conditions  for  fixed-order  dynamic  compensation  can 
be  simplified  by  exploiting  the  presence  of  a  previously  unrecognized  oblique 
projection.  The  resulting  optimal  projection  equations,  which  consist  of  a  pair  of 
modified  Riccati  equations  and  a  pair  of  modified  Lyapunov  equations  coupled  by  the 
optimal  projection,  yield  insight  into  the  structure  of  the  optimal  dynamic  com¬ 
pensator  and  emphasize  the  breakdown  of  the  separation  principle  for  reduced-order 
controller  design.  For  example,  the  optimal  compensator  is  the  projection  of  a  full- 
order  dynamic  controller  which  is  generally  different  from  the  LQG  design. 
Furthermore,  this  full-order  controller  and  the  oblique  projection  are  intricately 
related  since  they  are  simultaneously  determined  by  the  coupled  design  equations.  An 
immediate  consequence  is  the  observation  that  stepwise  schemes  employing  either 
model  reduction  followed  by  LQG  or  LQG  followed  by  model  reduction  are  generally 
suboptimal.  For  computational  purposes,  the  optimal  projection  equations  permit  the 
development  of  novel  numerical  methods  which  operate  through  successive  iteration 
of  the  oblique  projectic  .  (Hyland  and  Bernstein  1985).  Such  algorithms  are  thus 
philosophically  and  operationally  distinct  from  gradient  search  methods. 

The  generalization  of  the  optimal  projection  equations  to  the  decentralized  case  is 
straightforward  and  immediate.  In  the  optimization  process  each  subcontroller  is 
viewed  as  a  centralized  controller  for  an  augmented  ‘plant’  consisting  of  the  actual 
plant  and  all  other  subcontrollers.  It  need  only  be  observed  that  the  necessary 
conditions  for  optimality  for  the  decentralized  problem  must  consist  of  the  collection 
of  necessary  conditions  obtained  by  optimizing  over  each  subcontroller  separately 
while  keeping  the  other  subcontrollers  fixed.  More  precisely,  this  statement  corre¬ 
sponds  to  the  fact  that  setting  the  Frechet  derivative  to  zero  is  equivalent  to  setting  the 
individual  partial  derivatives  to  zero.  Hence  it  is  not  surprising  that  the  optimal 
projection  equations  for  the  decentralized  problem  involve  multiple  oblique  projec¬ 
tions,  one  associated  with  each  subcontroller.  Furthermore,  each  subcontrolier 
incorporates  an  internal  model  (in  the  sense  of  an  oblique  projection  of  full-order 
dynamics)  not  only  of  the  plant  but  also  of  all  other  subcontrollers.  The  structure  of 
the  equations  suggests  a  sequential  design  algorithm  such  as  that  proposed  in  this 
work. 
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The  simplicity  with  which  this  result  is  obtained  should  not  belie  its  relevance  to 
the  decentralized  control  problem.  Specifically,  our  approach  is  distinct  from  sub¬ 
system-decomposition  techniques  (Ikeda  and  Siljak  1980,  1981,  Ikeda  et  al.  1981, 
1984,  Lindner  1985,  Linnemann  1984,  Ozguner  1979,  Ramakrishna  and  Viswanadham 
1982,  Saeks  1979,  Sezer  and  Huseyin  1984,  Silkak  1978,  1983)  and  model-reduction 
methods  since  the  optimal  projection  equations  retain  the  full,  interconnected 
plant  at  all  times.  For  the  proposed  algorithm,  decomposition  techniques  which 
exploit  subsystem-interconnection  data  can  play  a  role  by  providing  a  starting  point 
for  subsequent  iterative  refinement  and  optimization.  Decomposition  methods  may 
also  play  a  role  when  very  high  dimensionality  precludes  direct  solution  of  the  optimal 
projection  equations.  These  are  areas  for  future  research. 

With  regard  to  the  role  of  the  oblique  projection,  it  should  be  noted  that  such 
transformations  do  not,  in  general,  preserve  plant  characteristics  such  as  poles,  zeros, 
subspaces,  etc.  Indeed,  since  the  oblique  projection  arises  as  a  consequence  of 
optimality,  approaches  that  seek  to  retain  system  invariants  (e.g.  Uskokovic  and 
Medanic  1985)  are  generally  suboptimal.  In  addition,  the  complex  coupling  among 
the  plant  and  subcontrollers  via  multiple  oblique  projections  provides  an  additional 
measure  for  evaluating  the  suboptimality  of  the  methods  proposed. 

The  plan  of  the  paper  is  as  follows.  The  fixed-structure  decentralized  dynamic- 
compensation  problem  is  stated  in  §  2  along  with  the  generalization  of  the  optimal 
projection  equations.  In  §  3  we  propose  a  sequential  design  algorithm  for  solving  these 
equations  and  state  conditions  under  which  convergence  is  guaranteed.  Finally,  in  §  4 
the  algorithm  is  applied  to  the  8th-order  model  of  a  pair  of  simply  supported  beams 
connected  by  a  spring.  For  this  example,  we  obtain  a  two-channel  decentralized 
design  which  is  4th-order  in  each  channel  and  compare  its  performance  with  the  (8th- 
order)  centralized  LQG  design. 


2.  Problem  statement  and  main  theorem 

Given  the  controlled  system 


x(t)  =  Ax(t)  +  £  B,u,(t)  +  w0(f) 

i*  l 

(2.1) 

y,(t)  =  C,x(t)  +  Wj(t),  i  =  1, ...,  p 

(2.2) 

design  a  fixed-structure  decentralized  dynamic  compensator 

Xc/(t)  =  Acixci(t)  +  Bciyj(t),  i  =  1 . p 

(2.3) 

«t(f)  =  Ccixjt),  i'=l . p 

(2.4) 

which  minimizes  the  steady-state  performance  criterion 

J(Ae i ,  Bc t ,  Ccl , . 

..,  Acp,  Bcp,  Ccp)  £  lim  E  x(t)TR0x(t)  +  £ 

I  -*  x  |_  i  *  I 

u,.(t)TR,.u,(t)J  (2.5) 

where,  for  i—  1, ... 

,  p:  x  e  R",  u,  e  1R"",  y,  e  R\  ccl  e  R"ci,  nc  4  £ 

"ch  nci^n  +  nc-  nci. 

A,  Bh  C,,  Aci,  Bci,  Cci,  R0  and  Rt  are  matrices  of  appropriate  dimension  with  R0 
(symmetric)  non-negative  definite  and  R,  (symmetric)  positive  definite;  w0  is  white 
disturbance  noise  with  nxn  non-negative-definite  intensity  F0,  and  w,  is  white 
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observation  noise  with  /,  x  positive-definite  intensity  Vh  where  w0,  w, , wp  are 
mutually  uncorrelated  and  have  zero  mean.  E  denotes  expectation  and  superscript  T 
indicates  transpose. 

To  guarantee  that  J  is  finite  and  independent  of  initial  conditions  we  restrict  our 
attention  to  the  set  of  admissible  stabilizing  compensators 

rf  £  {Mcl,  Bcl,  Ccl, ...,  Acp,  Bcp,  CQp):  A  is  asymptotically  stable} 
where  the  closed-loop  dynamics  matrix  A  is  given  by 

A  BCc1 
BcC  Ac\ 

where 

c; 

...  Bp],  : 

C„ 

Ac  4  block-diagonal  (Xcl, ...,  /fcp) 

Bc  £  block-diagonal  (Bcl, ....  Bcp) 

Cc  ^  block-diagonal  ( Cc  j , . . . ,  Ccp) 

^For  possibly  non-square  matrices  S, ,  S2,  block -diagonal  (S, ,  S2)  denotes  the 

matrix 

It  is  possible  that  for  certain  decentralized  structures  the  system  is  nut  stabilizable, 
i.e.  si  is  empty  (Wang  and  Davison  1973,  Seraji  1982,  Sezer  and  Siljak  1981).  Our 
approach,  however,  is  to  assume  that  si  is  not  empty  and  characterize  the  optimal 
decentralized  controller  over  the  stabilizing  class.  Since  the  value  of  J  is  independent 
of  the  internal  realization  of  each  subcompensator,  without  loss  of  generality  we  can 
further  restrict  our  attention  to 

si  +  ^  {(-4.1,  B«i.  Ccl,  ..,  Azp,  Bcp,  Czp)esi:(Azi,  BCI)  is  controllable  and 
(Ccj,  /4cj)  is  observable,  i  =  1, ....  p} 

The  following  lemma  is  an  immediate  consequence  of  Theorem  6.2.5,  p.  123  of  Rao 
and  Mitra  (1971).  Let  Ir  denote  the  r  x  r  identity  matrix. 

Lemma  2.1 

Suppose  Q,  P  e  R*  x*  are  non-negative  definite  and  rank  QP  =  r.  Then  there  exist 
G,  T  e  R,*«  and  invertible  M  sP.rxr  such  that 

QP  =  GrMV  (2.6) 

TGT  =  /r  (2.7) 

For  convenience  in  stating  the  main  theorem,  call  (G,  M,  f)  satisfying  (2.6),  (2.7)  a 
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projective  factorization  of  QP.  Such  a  factorization  is  unique  modulo  an  arbitrary 
change  in  basis  in  Rr,  which  corresponds  to  nothing  more  than  a  change  of  basis  for 
the  internal  representation  of  the  compensator  (or  subcompensators  in  the  present 
context). 

We  shall  also  require  the  following  notation.  Let  At  denote  A  with  the  rows  and 
columns  containing  Aci  deleted.  Similarly,  let  P,  be  obtained  by  deleting  the  rows  and 
columns  corresponding  to  Cj,  l?(Ccl  in  the  matrix 


R  4  block -diagonal  (R0,  C^P,^, ....  CjpRpCcp) 


And  furthermore,  P"  is  obtained  by  deleting  the  rows  and  columns  containing  Bci 
in 

V  4  block-diagonal  ( K0,  Bcl  F,  Bj„ ...,  Bcp  VpB]p) 

Also  define 


B>  .  Ci*lC,  ,] 


where  0rxl  denotes  the  r  x  s  zero  matrix.  Note  that  Ah  Bt,  Ch  P,  and  (7  essentially 
represent  the  closed-loop  system  minus  the  ith  subcontroller  as  controlled  by  the 
latter.  Finally,  define 


and,  for  r  e  Rrx'',  let 


2,  —  BiR~lEt],  l,AC]Vt-  lCt 


t  4  /  - 

‘1  ‘r 


Main  theorem 

Suppose  (/!,.,,  Bcl,  Ccl, ...,  Acp,  Bcp,  Ccp )  €  solves  the  steady-state  fixed- 

structure  decentralized  dynamic-compensation  problem.  Then  for  i  —  1 . p  there 

exist  (n  +  nc  —  nqi)  x(n  +  nc  —  ncl)  non-negative-definite  matrices  Qh  P,,  6,  and  P, 


such  that  Acl,  Bci  and  Ccl  are  given  by 

A*  =  TilAi  -  e,£,  -  S(P,)G7  (2.8) 

B^-r&CJvr1  (2.9) 

cci-  -Rf'BJPiGi  (2.10) 

for  some  projective  factorization  G„  M,,  T,  of  <5,P(,  and  such  that,  with  r,  =  Gj  I",,  the 
following  conditions  are  satisfied: 

0  =  AiQi  +  QiAj+  K-Q^iQi  +  h±QiZiQ,*l  (2.11) 

0  =  XfP,  +  PA  +  P,  -  P,I,P,  +  t7xPlI(Plt(1  (2.12) 

o  =  M,  -  Z,P()(2,  +  (M  -  Z,P,)T  +  <2,1(6.  -  ?u  6,2,6,^  (2.13) 

0  =  (i(  -  6.2, )TP,  +  AU  -  6,2,)  +  P,I,P,  -  T /xP.I.P.Tu  (2.14) 

rank  6,  =  rank  P,  =  rank  <5,  P,  =  nci  (2.1 5) 
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Remark  2.1 

Because  of  (2.7)  the  matrix  x ,  is  idempotent,  i.e.  xj  =  t,.  This  projection  corre¬ 
sponding  to  the  ith  subcontroller  is  an  oblique  projection  (as  opposed  to  an 
orthogonal  projection)  since  it  is  not  necessarily  symmetric.  Furthermore,  xL  is  given  in 
closed  form  by 

t  i^QtPAQiPiY 

where  (  )'  denotes  the  (Drazin)  group  generalized  inverse  (see,  for  example,  Campbell 
and  Meyer,  1979,  p.  124). 


3.  Proposed  algorithm 

Sequential  design  algorithm 

Step  1.  Choose  a  starting  point  consisting  of  initial  subcontroller  designs; 

Step  2.  For  a  sequence  {i*}“=1,  where  ik  e  {1, ....  p},  k=  1,2,...,  redesign  subcon- 
trollet  ik  as  an  optimal  fixed-order  centralized  controller  for  the  plant  and 
remaining  subcontrollers; 

Step  3.  Compute  the  cost  Jk  of  the  current  design  and  check  Jk  —  Jk  _ ,  for 
convergence. 

Note  that  the  first  two  steps  of  the  algorithm  consist  of  (i)  bringing  suboptimal 
subcontrollers  ‘on  line’  and  (ii)  iteratively  refining  each  subcontroller.  As  discussed  in 
§  1,  the  choice  of  a  starting  design  for  Step  1  can  be  obtained  by  a  variety  of  existing 
methods  such  as  subsystem  decomposition.  As  for  subcontroller  refinement,  note  that 
each  subcontroller  redesign  procedure  is  equivalent  to  replacing  a  suboptimal 
subcontroller  with  a  subcontroller  which  is  optimal  with  respect  to  the  plant  and 
remaining  subcontrollers. 

Proposition  3.1 

Fora  given  starting  design  and  redesign  sequence  { ik  }®= .  suppose  that  the  optimal 
projection  equations  can  be  solved  for  each  k  to  yield  the  global  minimum.  Then 
{Jk}k=i  *s  monotonically  non-increasing  and  hence  convergent. 

Determining  both  a  suitable  starting  point  and  redesign  sequence  for  solvability 
and  attaining  the  decentralized  global  minimum  remain  areas  for  future  research. 
With  regard  to  algorithms  for  solving  the  optimal  projection  equations  for  each 
subcontroller  redesign  procedure,  details  of  proposed  algorithms  can  be  found  in  the 
works  of  Hyland  (1983,  1984)  and  Hyland  and  Bernstein  (1985). 


4.  Application  to  interconnected  flexible  beams 

To  demonstrate  the  applicability  of  the  main  theorem  and  the  sequential  design 
algorithm,  we  consider  a  pair  of  simply  supported  Euler- Bernoulli  flexible  beams 
interconnected  by  a  spring  (see  the  Figure).  Each  beam  possesses  one  rate  sensor  and 
one  force  actuator.  Retaining  two  vibrational  modes  in  each  beam,  we  obtain  the  8th- 
order  interconnected  model 

/,u  M,  .,-h" 

^21  ^22_|  L  ®22 

Ci  =  [Cu  C2  =  [0I<4  ^22] 
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where 


Au  = 


0  aiu 

-wll-(fe/wu)(sin7tci)2  —2^01,, 
0  0 

-(&/cou)(sin  7rc,)(sin  2 nc,)  0 


0 

-(&/«2i)(sin  7rcf)(sin  Iitcf 
0 

-«2j-(/c/w2i)(sin  2jic,)2 


0 

0 

w2j 

-20* 


A;j- 


0  0  0  0 

{k/cjlj)(smnci)(sinncj)  0  (fc/co2;)(sin  7tc,)(sin  2ttc,)  0 

0  0  0  0 

[_(fc/ww)(sin  7tcv)(sin  27rc,)  0  (&/w2>)(sin  27tcj)(sin  2rcc;)  0 

i+j 


Bu  = 


,  Ci(  =  [0  sin  7tS(  0  sin  2ns^ 


0 

—  sin  nat 

0 

-  sin  27Mj 
ai~Qi/Li,  Si  —  sJLi ,  c,  =  cj  L( 


In  the  above  definitions,  k  is  the  spring  constant,  c ojt  is  the  jth  modal  frequency  of  the 
ith  beam,  C,  is  the  damping  ratio  of  the  ith  beam,  L,  is  the  length  of  the  ith  beam,  and 
di,  s,  and  c,  are,  respectively,  the  actuator,  sensor  and  spring-connection  coordinates 
as  measured  from  the  left  in  the  Figure.  The  chosen  values  are 
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k=W 

cou=  1,  ct)2i  =  4,  f,  =  0-005,  Lj  —  1,  i=l,2 
d1  =  03,  =  065,  =  06 

a  2  =  08,  i2  =  0-2,  c2  =  0-4 

In  addition,  weighting  and  intensity  matrices  are  chosen  to  be 


=  block -diagonal 
R2  =  R3=01/2 
V0  =  block-diagonal 


(P 

\L° 


o  i n  °  in  °  "IT1 

»  >  > 
ru,,J  |_0  l/w21  0  l/a>12  0 


0 

l/co22 


([: :](: :}[:  :]•[: 


Vx  =  v1  =  0-ll2 

For  this  problem  the  open-loop  cost  was  evaluated  and  the  centralized  8th-order 
LQG  design  was  obtained  to  provide  a  baseline.  To  provide  a  starting  point  for  the 
sequential  design  algorithm,  a  pair  of  4th-order  LQG  controllers  were  designed  for 
each  beam  separately  ignoring  the  interconnection,  i.e.  setting  k  =  0.  The  optimal 
projection  equations  were  then  utilized  to  iteratively  refine  each  subcontroller.  The 
results  are  summarized  in  the  Table. 


Design 

Cost 

Open  loop 

163-5 

Centralized  LQG 

nc  =  8 

19-99 

Suboptimal  decentralized 

«cl='»c2  =  4 

59-43 

Redesign  subcontroiler  2 

28-19 

Redesign  subcontroller  1 

23-29 

Redesign  subcontroller  2 

2304 

Redesign  subcontroller  1 

22-25 

Redesign  subcontroller  2 

21-94 

Redesign  subcontroller  l 

21-86 

Redesign  subcontroller  2 

21-81 

Redesign  subcontroller  1 

21-79 
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Abstract 

Sufficient  conditions  are  developed  for  designing  robust  decentralized  static  output  feedback 
controllers.  The  approach  involves  deriving  necessary  conditions  for  minimizing  a  bound  on  closed- 
loop  performance  over  «.  specified  range  of  uncertain  parameters.  The  effect  of  plant  parameter 
variations  on  the  closed-loop  covariance  is  overbounded  by  means  of  a  modified  Lyapunov  equation 
whose  solutions  are  guaranteed  to  provide  robust  stability  and  performance. 
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1.  Introduction 


Because  of  implementation  constraints,  cost,  and  reliability  considerations,  a  decentralized 
controller  architecture  is  often  required  for  controlling  large  scale  systems.  Furthermore,  such 
controllers  must  be  robust  to  variations  in  plant  parameters.  The  present  paper  addresses  both 
of  these  concerns  within  the  context  of  a  robust  decentralized  theory  for  continuous-time  static 
controllers. 

The  approach  to  controller  design  considered  herein  involves  optimizing  closed-loop  perfor¬ 
mance  with  respect  to  the  feedback  gains.  This  approach  to  output  feedback  was  studied  for 
centralized  controllers  in  [8,9]  and  for  decentralized  controllers  in  [10].  An  interesting  feature  of 
[9,10]  is  the  recognition  of  an  oblique  projection  (idempotent  matrix)  which  allows  the  necessary 
conditions  to  be  written  in  terms  of  a  modified  Riccati  equation.  When  the  problem  is  specialized 
to  full-state  feedback,  the  projection  becomes  the  identity  and  the  modified  Riccati  equation  coin¬ 
cides  with  the  standard  Riccati  equation  of  LQR  theory.  It  should  be  pointed  out  that  this  oblique 
projection  is  distinct  from  the  oblique  projection  arising  in  dynamic  compensation  ([7]).  A  unified 
treatment  of  the  static  /dynamic  (nonstrictly  proper)  centralized  control  problem  involving  both 
projections  is  given  in  [2]. 

The  present  paper  goes  beyond  earlier  work  by  deriving  sufficient  conditions  for  robust  stability 
and  performance  with  respect  to  variations  in  the  plant  parameters.  Although  plant  disturbances 
are  represented  in  the  usual  stochastic  manner  by  means  of  additive  white  noise,  uncertainty  in  the 
plant  dynamics  is  modeled  deterministically  by  means  of  constant  structured  parameter  variations 
within  bounded  sets.  Thus,  for  example,  the  dynamics  matrix  A  is  replaced  by  A  +  i  akAk, 
where  ak  is  a  constant  uncertain  parameter  assumed  only  to  lie  within  the  interval  [-a*, a*]  but 
otherwise  unknown,  and  Ak  is  a  fixed  matrix  denoting  the  structure  of  the  uncertain  parameter 
ak  as  it  appears  in  the  nominal  dynamics  matrix  A.  The  system  performance  is  defined  to  be  the 
worst-case  value  over  the  class  of  parameter  uncertainties  of  a  quadratic  criterion  averaged  over  the 
disturbance  statistics. 

Since  the  closed-loop  performance  can  be  written  in  terms  of  the  second-moment  matrix,  a 
performance  bound  over  the  class  of  uncertain  parameters  can  be  obtained  by  bounding  the  state 
covariance.  The  key  to  bounding  the  state  covariance  is  to  replace  the  usual  Lyapunov  equation  for 
the  second-moment  matrix  by  a  modified  Lyapunov  equation.  In  the  present  paper  the  modified 
Lyapunov  equation  is  constructed  by  adding  two  additional  terms.  The  first  term  corresponds  to  a 
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uniform  right  shift  of  the  open-loop  dynamics.  As  is  well  known  ([1]),  such  a  shift  may  arise  from 
an  exponential  performance  weighting  and  leads  to  a  uniform  stability  margin  for  the  closed-loop 
system.  In  order  to  guarantee  robustness  with  respect  to  specified  structured  parameter  variations, 
however,  an  additional  term  of  the  form  AfcQAj  is  required.  Such  terms  arise  naturally  in  systems 
with  multiplicative  white  noise;  see  [3,4]  and  the  references  therein  for  further  details.  The  expo¬ 
nential  cost  weighting  and  multiplicative  noise  interpretations  for  the  uncertainty  bound  have  no 
bearing  in  the  present  paper,  however,  since  parameter  variations  are  modeled  deterministically  as 
constant  variations  within  bounded  sets. 

Having  bounded  the  state  covariance  over  the  class  of  parameter  uncertainties,  the  worst-case 
performance  can  thus  be  bounded  in  terms  of  the  solution  of  the  modified  Lyapunov  equation.  The 
performance  bound  can  be  viewed  as  an  auxiliary  coat  and  thus  leads  to  the  Auxiliary  Minimization 
Problem:  Minimize  the  performance  bound  while  satisfying  the  modified  Lyapunov  equation.  The 
nice  feature  of  the  auxiliary  problem  is  that  necessary  conditions  for  optimality  of  the  performance 
bound  now  serve  as  sufficient  conditions  for  robust  performance  in  the  original  problem.  Thus  our 
approach  seeks  to  rectify  one  of  the  principal  drawbacks  of  necessity  theory,  namely,  guarantees 
of  stability  and  performance.  Furthermore,  it  should  be  noted  that  if  numerical  solution  of  the 
optimality  conditions  yields  a  local  extremal  which  is  not  the  global  optimum,  then  robust  stability 
and  performance  are  still  guaranteed,  although  the  performance  of  the  extremal  may  not  be  as 
good  as  the  performance  provided  by  the  global  minimum.  Philosophically,  the  overall  approach 
of  control  design  for  a  performance  bound  is  related  to  guaranteed  cost  control  ([6]).  We  note, 
however,  that  the  bound  utilized  in  [6]  is  nondifferentiable,  which  precludes  the  approach  of  the 
present  paper. 

A  further  extension  of  previous  approaches  considered  in  the  present  paper  involves  the  types 
of  feedback  loops  considered.  Specifically,  the  usual  approach  to  static  output  feedback  involves 
nonnoisy  measurements  and  weighted  controls,  while  the  dual  problem  involves  feeding  back  noisy 
measurements  to  unweighted  controls.  This  situation  leads  to  an  additional  projection  ([2])  which 
is  dual  to  the  projection  discussed  in  [9,10].  The  inclusion  of  the  dual  case  now  leads  to  a  pair  of 
modified  Riccati  equations  coupled  by  both  the  uncertainty  bounds  and  the  oblique  projections. 

In  addition  to  the  two  types  of  loops  discussed  above,  one  may  wish  to  consider  the  two 
remaining  cases,  namely,  feeding  back  noisy  measurements  to  weighted  controls  and  feeding  back 
nonnoisy  measurements  to  unweighted  controls.  It  is  easy  to  show,  however,  that  the  former  case 
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leads  to  an  undefined  (i.e.,  infinite)  value  for  the  performance  while  the  latter  case  is  highly  singular 
and  thus  will  not  be  treated  here. 

Finally,  the  scope  of  the  present  paper  is  limited  to  the  development  of  sufficient  conditions  for 
robust  decentralized  output  feedback.  Numerical  solution  of  these  equations  can  be  carried  out  by 
extending  available  algorithms  for  centralized  output  feedback.  Numerical  algorithms  for  solving  a 
single  modified  Riccati  equation  in  the  absence  of  uncertainty  bounds  are  discussed  in  [10]. 


2.  Notation  and  Definitions 


IR,IRrX‘,IRr,lE 
Ir,  (  )T 

e,  ® 
sr 

INr 

IPr 

Z\  ^  Zj 
Z\  < 

asymptotically 
stable  matrix 
n,r,3,p 

hj:k 

my,  tj 
x 

A,AA 

Bi ,  A  Bi ;  Ci 

Bj ;  Cj,  A  Cj 

Ak 

Bik 

Cjk 

Dn 

Ea 

a 

A* 

<*k 

Ik 

<Tk 

vo(t),u>j(t) 


real  numbers,  r  x  s  real  numbers,  IR’’*1,  expectation 
r  x  r  identity,  transpose 
Kronecker  sum,  Kronecker  product  ([5]) 
r  x  r  symmetric  matrices 

r  x  r  symmetric  nonnegative-definite  matrices 
r  x  r  symmetric  positive-definite  matrices 

z3-z1e  iNr,  z1>z3esr 
Z3  —  Z\  €  lPr ,  Z\ ,  Z3  €  sr 
matrix  with  eigenvalues  in  open  left  half  plane 

positive  integers 

indices,  *  =  1, ...  ,r,  jf  =  1,  ...,s,  fc=l,...,p 

positive  integers,  *  =  1, . . . ,  r 

positive  integers,  j  =  1, . . . ,  s 

n-dimensional  vector 

rrii,  4-dimensional  vectors,  *  =  1, . . . ,  r 

rhj,  ^ -dimensional  vectors,  j  =  !,...,« 

n  x  n  matrices 

nx  mi  matrices;  Li  x  n  matrices,  »  =  1, . . . ,  r 
n  x  rhj  matrices;  tj  x  n  matrices,  j  =  1, . . . ,  s 
n  x  n  matrices,  k  =  1, . .  .p 
n  x  mi  matrices,  i  =  1, . . . ,  r,  k  =  1, . . .  ,p 
tj  x  n  matrices,  j  =  1, . . . ,  s,  k  =  1, . . . ,  p 
mi  x  t\  matrices,  *  =  1, . . . ,  r 
rhj  x  tj  matrices,  j  =  1, . . . ,  s 
positive  number 
A  +  f/n 

positive  number,  k  =  1, . . .  ,p 

al/a,  fc  =  l,...,p 

real  number,  k  =  1, . . .  ,p 

n-dimensional,  ^-dimensional  white  noise,  j  =  1, . . . ,  s 
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Vo.V- 

intensities  of  wo.u/y;  V0  €  IN",  V3-  €  IP4*,  j  =  1, . , 

Voj 

n  x  tj  cross  intensity  of  wq  ,  w3 ,  j  =  1,. . . ,« 

Rq,  Ri 

state  and  control  weightings;  Bo  €  INn,  Rj  €  IPm<, 

R<h 

n  x  m»  cross  weighting;  B0  -  RcnR~1R%i  >  0,  i  = 

A,  Aa 

A  +  ELi  +  E'=1  BjEejCj  A+  f/n 

AA 

AA  +  E;=i  ABiDs,C,  +  E'=1  B,EC3AC, 

w(t) 

«»o  (0  +  Ey=i  B:  EC3Wj(t) 

R 

Ro  +  ELilPw^C.  +  +  CTDS^^QI 

V 

Vo  +  E^JVoy^Bf  +  B:£ejV£  +  &&&&*£*] 

For  arbitrary  n  X  n  Q,P  define: 
Rai  =  Ri  +  Yl'1kBTkPBk, 

Jfcss  1 

v;=vi  +  f l^c,kQCjk, 

fc=i 


P«  =  BfP  +  ^  +  ^7fcBffcPAfc,  t  =  l,...,r, 
fc=x 
j> 

+  Vo j  +  53  'tkA.kQCfk,  j  =  1, . . . ,  a. 
In si 


3.  Robust  Stability  and  Performance  Problem 

In  this  section  we  state  the  Robust  Stability  and  Performance  Problem  along  with  related 
notation  for  later  use.  Let 

u  c  IRnx"  x  jRnxmi  x  ...  x  nv*xm'  X  IR4lXn  x  ...  x  IR**Xn 

denote  the  set  of  uncertain  perturbations  (A  A,  ABi , . . . ,  A  Br,  A  Ci AC,)  of  the  nominal  sys¬ 
tem  matrices  A,  B1 , . . . ,  Bri  Ci , . . . ,  C,. 

Robust  Stability  and  Performance  Problem.  Determine  (DeX,- ■  •  ,Der,Eci,. . .  ,Ee,) 
such  that  the  closed-loop  system  consisting  of  the  nth-order  controlled  and  disturbed  plant 

r  9 

x(t)  =  (A  +  AA)z(t)  +  53(B<  +  +  53  +  u/o(t),  t  6  [0, oo),  (3.1) 

i=i  ;=i 

nonnoisy  and  noisy  measurements 

fcW  =  C’iz(t),  «  =  l,...,r,  (3.2) 

yy (0  =  (<?;  +  ACy)i(t)  +  «,,(t)f  j  =  (3.3) 

and  static  output  feedback  controller 


u,(t)  —  Bc,y,(t),  i  —  1, . . . ,  r, 


(3.4) 
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Uj'(t)  —  Eejyj(t),  j  —  1) .  • .  >  ®, 

is  asymptotically  stable  for  all  variations  in  U  and  the  performance  criterion 

J(DcU  •  •  •  i^erj  -^elj  •  ■  •  >  Ect)  ~ 

r  r 

suplimsupIE[xr(f)i?oz(f)  +  2  Y"'  x  7  (t)jRoi  <*«(*)  +  uf  (t)fjjtxj(t)] 

«  7T[ 

is  minimized. 

For  each  controller  (De  it ....  Der,  Eci  Eet)  and  variation  in  U,  the  closed-loop  system  (3.1)- 

(3.5)  is  given  by 

i(t)  =  (A  +  AA)z(j)  +  tl(t),  t€[0,oo),  (3.7) 

where  tS(f)  is  white  noise  with  intensity  V  £  INn . 

Remark  3.1.  In  the  case  A  A,  AB+,  ACj  =  0  it  is  well  known  that  stabilizability  is  related  to 
the  existence  of  fixed  modes  ([11]).  When  plant  uncertainties  are  present  the  problem  is,  of  course, 
far  more  complex.  In  the  present  paper  sufficient  conditions  for  robust  stability  are  obtained  as  a 
consequence  of  the  existence  of  robust  performance  bounds. 

Remark  3.2.  Note  that  the  controller  architecture  is  quite  general  in  that  it  includes  two 

distinctly  different  types  of  decentralized  loops.  The  first  type,  indexed  by  »  =  1 . r,  involves 

feeding  back  nonnoisy  measurements  to  weighted  controls.  This  is  the  standard  setting  in  the 
optimal  output-feedback  literature  ([8-10]).  In  addition,  we  include  the  dual  situation,  indexed  by 
j  =  1 which  involves  feeding  back  noisy  measurements  to  unweighted  controls.  The  case  in 
which  only  one  type  of  loop  is  present  can  be  formally  recovered  from  our  results  by  ignoring  Bi 
and  Ci  or  By  and  Cy  as  required.  As  noted  in  Section  1,  noisy  measurements  cannot  be  fed  back 
to  weighted  controls  via  static  control,  while  feeding  back  nonnoisy  measurements  to  unweighted 
controls  is  a  singular  problem. 

Remark  3.3.  Note  that  the  problem  statement  is  restrictive  in  the  sense  that  uncertainties 
in  both  the  control  and  observation  matrices  are  not  permitted  within  the  same  feedback  loop. 
Although  it  is  indeed  possible  to  permit  such  simultaneous  uncertainties,  the  development  is  con¬ 
siderably  more  complex  and  hence  is  not  treated  here. 

Remark  3.4.  The  cost  functional  (3.6)  is  identical  to  the  LQG  criterion  (usually  stated  in 
terms  of  an  averaged  integral)  with  the  exception  of  the  supremum  for  evaluating  worst  case  over 
U. 


(3.5) 


(3.6) 
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4.  Sufficient  Conditions  for  Robust  Stability  and  Performance 

In  practice,  steady-state  performance  is  only  of  interest  when  the  closed-loop  system  (3.7) 
is  stable  over  U.  The  following  result,  which  expresses  the  performance  in  terms  of  the  state 
covariance,  is  immediate. 

Lemma  4.1.  Let  (Del, . . . ,  Der, Ee i, . . . ,  Ee»)  be  given  and  suppose  the  system  (3.7)  is  stable 
for  all  variations  in  U.  Then 

J(Dei,...,Der,Eei,...,Ee,)  =  sup  ttQ^R,  (4.1) 

where  ®  limt—oo  IE[x(t)xr(t)]  €  IN'*  is  the  unique  solution  to 

0={A  +  AA)QlA  +  Q^{A  +  AA)t  +  V.  (4.2) 


Remark  4.1.  When  U  is  compact,  “sup”  in  (4.1)  can  be  replaced  by  “max” . 

We  now  seek  upper  bounds  for  J{Dei, . . .  ,Der,Eei, . . .  ,Ee0).  Our  assumptions  allow  us  to 
obtain  robust  stability  as  a  consequence  of  robust  performance. 

Theorem  4.1.  Let  17  :  IN"  x  IRmiX*1  X  . .  .ntm,x*-  x  JR*1'*1'  x  . . .  x  — ►  Sn  be  such 


that 

AAQ  +  QAAt  <  n(Q,  Dei,  •  •  • ,  De„  EeX, . . . ,  Ee,), 

(A A,  A . . . ,  AB„AC, , . . . ,  AC.)  €  U, 

(Q,Dei,...,Der,Eei,...,Ee,)  €  IN"  x  IRmixil  x  ...  x  lRm'x^  x  nt’*lXtl  x  ...  x  ni**xi*. 

(4.3) 

Furthermore,  for  given  (Dei, Dcr,  Eei, Ect)  suppose  there  exists  Q  €  IN"  satisfying 

0  =  AQ  +  QAt  +  n(Q,Dei, . . . ,  Dcr,  Bei, . . . ,  Ee0)  +  V .  ‘  (4.4) 


Then  the  pair  (A  +  A  A,  Vi)  is  stabilizable  for  all  variations  in  U  if  and  only  if  A  4-  A  A  is  asymp¬ 
totically  stable  for  all  variations  in  U.  In  this  case, 


<3 


AA 


i<Q> 


(4.5) 


where  satisfies  (4.2),  and 

J(Dci, •  •  •  i  ^en  Eci , . . . ,  Ee0)  —  QR- 


(4-6) 
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Proof.  For  all  variations  in  U,  (4.4)  is  equivalent  to 


0  =  (A  +  A  A)Q  +  Q(A  +  AAf  +${Q,Del . Der,  Eel,...,  Ect,  A  A)  +  V,  (4.7) 


where 


*(<?,  Del, . . . ,  Dcr,  Eel,...,  Ee„  AA)  4  n(Q,  DeU...,  Der,  EeU...,  Ee.)  -  (A  AQ  +  QAAT). 

Note  that  by  (4.3),  #(•)  >  0  for  all  variations  in  U.  If  (A  +  AA,V$)  is  stabilizable  for  all  variations 
in  U,  it  follows  from  Theorem  3.6  of  [12]  that  (A+AA,  [V  +${Q,De lt . . .  ,Der,  Ee i, . . . ,  Eet,  AA)]^) 
is  stabilizable  for  all  variations  in  U.  Hence  Lemma  12.2  of  [12]  implies  A+  A  A  is  asymptotically 
stable  for  all  variations  in  U.  The  converse  is  immediate.  Next,  substracting  (4.2)  from  (4.7)  yields 


0  =  (A  +  AA)(Q  -  Q&j)  +  (Q  -  Q^)(A  +  AA)T  +  *(<?.  •  •  •  > Dcr,  Eel . Eet,  A  A), 

or,  equivalently,  (since  A  +  AA  is  asymptotically  stable) 

Q-Q±a=  r  «(yi+Avi)t#(Q,  Dc *,...,  Der,  Eel . Ee.,  A A)M+^Ttdt  >  0, 

Jo 

which  implies  (4.5).  Finally,  (4.5)  and  (4.1)  yield  (4.6).  □ 

Remark  4.2.  If  V  is  positive  definite  then  the  stabilizability  hypothesis  of  Theorem  4.1  is 
automatically  satisfied  for  all  variations  in  U. 


5.  Uncertainty  Structure  and  the  Quadratic  Lyapunov  Bound 

The  uncertainty  set  U  is  assumed  to  be  of  the  form 

U  =  {(AA,AR1,...,ABr,ACl,...,AC.)  : 

p  p 

AA  =  ^(TfcAfc,  ABi  =  ^<rkBik,  t  =  l,...,r, 


fc=i 
p 


fc= l 


(5.1) 


AC,  =  £  °kCjk,  j  =  1 . s,  <r\/a\  <  1}, 

*=i  fc=i 

where,  for  k  =  1, . . .  ,p  :  (A*,  Bik,  ■  ■  • ,  Brk,Cik,  •  ■  •  ,C,*)  are  fixed  matrices  denoting  the  structure 
of  the  parametric  uncertainty;  is  a  given  uncertainty  bound;  and  <?k  is  an  uncertain  parameter. 
Note  that  the  uncertain  parameters  a*  are  assumed  to  lie  in  a  specified  ellipsoidal  region  in  IRP. 
The  closed-loop  system  thus  has  structured  uncertainty  of  the  form 

p 


A  A=  ^<rfcAfc, 


(5.2) 


fc=l 
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where 


(5.3) 


r  • 

Ak  —  Ak  +  ^  "]  BikDgiCi  +  ^  '  BjEejCjk,  k  —  1, . . .  ,p. 

♦= i  ;=i 

To  obtain  explicit  gain  expressions  for  ( Del,...,Der,Eei,...,Ee ,)  we  assume  that,  for  each 
k  €  {1, . . .  ,p},  at  most  one  of  the  matrices  Bik, . . . ,  Rrfc>  Cu, . . . , Ctk  is  nonzero.  Note  that  this 
assumption  does  not  preclude  the  treatment  of  uncertainties  in  the  input  and  output  matrices.  It 
requires  only  that  such  uncertainties  be  modeled  as  uncorrelated. 

Given  the  structure  of  U  defined  by  (5.1),  the  bound  Cl  satisfying  (4.3)  can  now  be  specified. 
In  the  following  result  Q  denotes  an  arbitrary  element  of  INn,  not  necessarily  a  solution  of  (4.4). 

Proposition  5.1.  Let  a  be  an  arbitrary  positive  scalar.  Then  the  function 

p 

C2(Q,  Dci , . . . ,  Dcr,  Ee i, . . . ,  ECt)  —  o tQ  +  0  1  ^  ^  o\AkQA^  (5-4) 

kssl 

satisfies  (4.3)  with  U  given  by  (5.1). 

Proof.  Note  that 

p 

0  <  53  [(°[’<rk/a[kU»  -  (<WQ*Mk]<3[(a*<rfc/otk)/n  -  (afc/a»)At] 

ksl 

=  a^2(*l/aDQ  +  al*kQAl  -  ^2  c rk{AkQ  QAl), 

ks=l  kssl  fc=l 

which  yields  (4.3).  □ 

Remark  5.1.  Note  that  the  bound  Cl  given  by  (5.4)  consists  of  two  distinct  terms.  The  first 
term  aQ  can  be  thought  of  as  arising  from  an  exponential  time  weighting  of  the  cost,  or,  equivalently, 
from  a  uniform  right  shift  of  the  open-loop  dynamics  ([l]).  The  second  term  a-1  £k=i  a2kAkQAl 
arises  naturally  from  a  multiplicative  white  noise  model  ([3,4]).  Such  interpretations  have  no  bearing 
on  the  results  obtained  here  since  only  the  bound  Cl  defined  by  (5.4)  is  required.  Note  that  the 
bound  is  valid  for  all  positive  a.  . 


Remark  5.2.  The  conservatism  of  the  bound  (5.4)  is  difficult  to  predict  for  two  reasons.  First, 
the  overbounding  (4.3)  holds  with  respect  to  the  partial  ordering  of  the  nonnegative-definite  matri¬ 
ces  for  which  no  scalar  measure  of  conservatism  is  available.  And,  second,  the  bound  (4.3)  is  required 
to  hold  for  all  nonnegative-definite  matrices  Q  and  feedback  gains  (X?ci,  •  •  •  1  Dcr,  Eei,  ■  ,  Eet).  The 

conservatism  will  thus  depend  upon  the  actual  values  of  Q,  De  1, . . . ,  Dcr,  Ee\,-  •  • ,  Eet  determined 
by  solving  (4.4). 
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6.  The  Auxiliary  Minimization  Problem  and  Necessary  Conditions  for  Optimality 

Rather  than  minimizing  the  actual  cost  (3.6),  we  shall  consider  the  upper  bound  (4.6).  This 
leads  to  the  following  problem. 

Auxiliary  Minimization  Problem.  Determine  (Q,  De  i, . . . ,  Der,  Ecl,...,  Ect)  which  mini¬ 
mizes 

J(Q,  Dei,  •  •  •  i  DCr,  Eei,  •  •  •  ,  Egt)  —  tr  QR  (6.1) 

subject  to 

Q  S  IN",  (6.2) 

p 

0  =  AaQ  +  QAl  +  Y^'1kAkQAl  +  V.  (6.3) 

fc=i 

The  relationship  between  the  Auxiliary  Minimization  Problem  and  the  Robust  Stability  and 
Performance  Problem  is  straightforward  as  shown  by  the  following  observation. 

Proposition  6.1.  Suppose  (Q,  Dcl, . . . ,  Der,  Ee i, . . . ,  Ect)  satisfies  (6.2)-(6.4).  Then 

(A  +  A A,V* )  is  stabilizable  for  all  variations  in  U  (6.4) 

if  and  only  if  A  +  A  A  is  asymptotically  stable  for  all  variations  in  U.  In  this  case, 

«f(-Del» . .  .  ,  Dcr,  Eel,  •  •  •  >  Stl)  —  Dcl,  •  •  •  >  Der,  Belt  •  •  • ,  Dea)-  (6-5) 

Proof.  With  n  given  by  (5.4),  Proposition  5.1  implies  that  (4.3)  is  satisfied.  Since  the  hy¬ 
potheses  of  Theorem  4.1  are  satisfied,  robust  stability  with  performance  bound  (4.6)  is  guaranteed. 
Note  that  with  definition  (6.1),  (6.5)  is  merely  a  restatement  of  (4.6).  □ 

The  derivation  of  the  necessary  conditions  for  the  Auxiliary  Minimization  Problem  is  based 
upon  the  Fritz  John  form  of  the  Lagrange  multiplier  theorem.*  Rigorous  application  of  this  tech¬ 
nique  requires  that  ( Q ,  Dei, . . . ,  Der,  Eei, ....  Ec,)  be  restricted  to  the  open  set 

$  =  {(Q,  Dei,  ■  •  •  >  Der,  Eei,. . . ,  Ee,)  :  Q  €  IP"  and  A  is  asymptotically  stable}, 

*  The  Kuhn-Tucker  theorem  requires  a  priori  verification  of  a  constraint  qualification  which  is 
difficult  to  confirm  in  the  present  context.  The  Fritz  John  version  is  less  restrictive  and  hence  more 
suitable. 
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where 


A  =  Aa  ©  Aa  +  ^2  IkAk  ®  Ak. 

k—i 

The  requirement  (Q,  Dei, ...  ,Der,  Eei, .  ..,£*•)  €  S  implies  that  Q  and  its  nonnegative-definite 
dual  P  are  unique  solutions  to  the  modified  Lyapunov  equations  (6.3)  and 

p 

0  =  AlP  +  PAa  +  J2  'ikAlPAk  +  R.  (6.6) 

An  additional  technical  requirement  is  that  (Q,  Dcl} . . . ,  Dcr,  Ee  lt ... ,  Eet)  be  confined  to  the  set 
S+ =  {(Q,D'1>..,Der,Ecl,...,Ee.)eS:  CiQCj  >  0,  i=l,...,r, 

&adBjPBj>0,  3  —  1 . »}• 

The  positive  definiteness  conditions  in  the  definition  of  $  +  hold  when  Ct-  and  Bj  have  full  row  and 
column  rank,  respectively,  and  Q  and  P  are  positive  definite.  As  can  be  seen  from  the  proof  of 
Theorem  6.1  these  conditions  imply  the  existence  of  the  projections  v,  and  0j  corresponding  to  the 
two  distinct  types  of  feedback  loops.  Note  that  $+  is  open. 

Remark  6.1.  As  pointed  out  in  Remark  3.1,  the  set  S  may  be  empty  in  which  case,  of  course, 
our  results  do  not  apply.  As  will  be  seen,  however,  our  approach  does  not  require  explicit  verification 
that  S  be  nonempty  since  robust  stability  is  obtained  as  a  consequence  of  robust  performance. 

Remark  6.2.  As  will  be  seen,  the  constraint  (Q,Del,...,Z?er,  Eei,. . .  ,Eet)  €  S  need  not 
be  verified  in  practice  and  is  not  required  for  either  robust  stability  or  robust  performance  since 
Proposition  6.1  shows  that  only  (6.2)-(6.4)  are  needed.  Rather,  the  set  $  constitutes  sufficient 
conditions  under  which  the  Lagrange  multiplier  technique  is  applicable  to  the  Auxiliary  Minimiza¬ 
tion  Problem.  Specifically,  the  condition  Q  >  0  replaces  (6.2)  by  an  open  set  constraint,  while  the 
asymptotic  stability  of  A  serves  as  a  normality  condition  which  further  implies  that  the  dual  P  of 
Q  is  nonnegative  definite. 

Necessary  conditions  for  the  Auxiliary  Minimization  Problem  can  now  be  obtained. 

Theorem  6.1.  If  (Q,  Dci,. . . ,  Dcr,  Eei,. . . ,  Ee,)  €  S+  solves  the  Auxiliary  Minimization 
Problem  with  U  given  by  (5.1),  then  there  exist  Q,P  £  IN"  such  that  Dex, . . . ,  Der,  Ee i, . . . ,  Ec, 
are  given  by 

Dci  =  -RZiPaiQCf{CiQCl)-\  i  =  1, . . .  ,r,  (6.7) 

Eej  =  -(BfPBjr'dJPQajV-1,  j  =  1, . . .  ,s,  (6.8) 
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and  such  that  Q,P  satisfy 


0  =  (Aa-'£  BiR~lPaiux)Q  +  Q(Aa  -  E  B,R;,1  Patv,)T  +  V0 

»= i  «=i 

+  E  V*(Ak  -  ]T  BikR^Paiu,)Q(Ak  -  £  BikR:?Paivi)T 

fc= i  »=i  «=i 

-  E  e^'Qly  +  E  VolAu. 

i=i  i=i 

0  =  (A.  -  E  »iQ»v*Ci)TP  +  -P(^  -  E  *iQ*iVjCj)  +  Ro 

i=i  j=i 

+  E  ^*(A*  -  E  »>Q«^7lc*)TP(  A  -  E  OjQajV-lcjk) 

*=i  j=i  y=i 

-  YIpXp™  + 

»•= i  «=i 


(6.9) 


(6.10) 


i/.^gc^c.gcf)-^,,  vi±^in-Vi,  i  =  i,...,r,  (e.n) 

4  Bj  (BjPBj )  ~ 1  BjP,  i>jX  ±In-  »„  ysl . I.  (6.12) 

Furthermore,  the  auxiliary  cost  is  given  by 

J(Q,  fAel,  •  •  •  »  Deri  Belt  •  •  •  )  -Ee»)  = 

tr[Q(iJb  +  E;  vf  PfiRZi  BiRZi  PtiVi  -  ZRoiR^PaiVi)} .  (613) 

»=1 

Conversely,  if  there  exist  Q,P  €  IN"  satisfying  (6.9)  and  (6.10)  then  Q  satisfies  (6.3)  with 
(Dei, . . . ,  Der,  Eei, . . . ,  Ec)  given  by  (6.7)  and  (6.8),  and  J(Q,Dei,-..,Der,Eei,...,Ee ,)  is  given 
by  (6.13). 


Proof.  To  optimize  (6.1)  over  the  open  set  S  +  ,  subject  to  the  constraint  (6.3),  form  the 
Lagrangian 

p 

£(Q>  Bei,  •  ■  •  i  Der,  Eei >  •  •  •  i  Eet)  =  tr[AQi?  +  ( AQ  +  QAT  +  lkAkQAk  +  V)P] , 

fc=i 

where  the  Lagrange  multipliers  A  >  0  and  P  €  IR"X"  are  not  both  zero.  Setting  dC/dQ  =  0,  A  =  0 
implies  P  —  0  since  A  is  asymptotically  stable.  Hence,  without  loss  of  generality  set  A  =  1.  Thus 
the  stationarity  conditions  are  given  by 

f|  =  AlP  +  PAa  +  E  1kATkPAk  +  R  =  0, 


(6.14) 


*  =  l,...,r,  (6.15) 

j  =  l,...,s.  (6.16) 

Since  (Q,  Del,...,  Dtr ,  Eel,...,  Eet)  €  $+,  CiQC f  and  Bj  PB}  are  invertible  and  hence  (6.15) 
and  (6.16)  imply  (6.7)  and  (6.8).  Finally,  (6.9)  and  (6.10)  are  equivalent  to  (6.3)  and  (6.6).  □ 

Remark  6.3.  Several  special  cases  can  be  recovered  formally  from  Theorem  6.1.  For  example, 
when  the  control  weighting  is  nonsingular  and  the  measurement  noise  is  zero,  i.e.,  when  U{  and  y, 
are  absent  for  i  =  1, . . .  ,r,  delete  (6.8)  and  set  Vj  =  0  in  (6.9).  In  this  case  the  last  two  terms  in 
(6.9)  can  be  deleted.  Deleting  also  the  uncertainty  terms  Ak ,  B,k,  C/a  yields  the  results  of  [10] 
with  the  added  features  of  correlated  plant/measurement  noise  (Vo/)  and  cross  weighting  (Roi). 
Furthermore,  assuming  a  centralized  structure  for  the  static  controller,  i.e.,  r  =  1,  yields  the  usual 
static  output  feedback  result  ([8,9]). 

7.  Sufficient  Conditions  for  Robust  Stability  and  Performance 

We  now  combine  Proposition  6.1  and  Theorem  6.1  to  obtain  sufficient  conditions  for  robust 
stability  and  performance. 

Theorem  7.1.  Suppose  there  exist  Q,P  G  IN"  satisfying  (6.9)  and  (6.10).  Then  with 
(Dei,. . . ,  Der,  Ee\, . . .  ,Eet)  given  by  (6.6)  and  (6.7),  (A  +  Ai4,Vs,)  is  stabilizable  for  all  vari¬ 
ations  in  U  if  and  only  if  A  +  A  A  is  asymptotically  stable  for  all  variations  in  U .  In  this  case  the 
performance  of  the  closed-loop  system  satisfies  the  bound 

p 

J(Del,...,Der,Eei,...,Ee.)  <  tr[Q(Ro  +  Ylv?P?iR*ilKR;<lPai''i-2RoiR:iLPaii'i)}.  (7.1) 

»=1 

Proof.  The  converse  of  Theorem  6.1  shows  that  Q  satisfies  (6.3)  with  (Z7ei,  •  • ,  Der, 
Eei . £«•)  given  by  (6.7)  and  (6.8).  Hence,  with  the  stabilizability  assumption  (6.4),  Propo¬ 

sition  6.1  implies  robust  stability  and  performance.  □ 

Remark  7.1.  The  application  of  Theorem  7.1  in  practice  requires  1)  numerical  solution  of 
(6.9)  and  (6.10),  and  2)  verification  of  the  stabilizability  hypothesis.  No  other  assumptions  need 
be  verified  in  applying  this  result. 


J~~  =  RaiDeAQC f  +  PaiQC f  =  0, 
=  BjPBjEejVai  +  BjPQa,  =  0, 
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8.  Concluding  Remarks 


We  have  developed  a  theory  of  robust  decentralized  output  feedback  via  static  control.  The 
development  permits  the  treatment  of  noisy  and  nonnoisy  measurements,  weighted  and  unweighted 
controls,  and  structured  real-valued  parameter  uncertainties  in  the  plant  matrices.  The  theory 
provides  a  robustification  of  results  given  in  [8-10]  for  both  centralized  and  decentralized  optimal 
output  feedback.  The  theory  is  constructive  in  nature  rather  than  existential.  Specifically,  the 
main  result,  Theorem  7.1,  involves  a  coupled  pair  of  modified  Riccati  equations  (6.9),  (6.10)  whose 
solutions,  when  they  exist,  are  used  to  explicitly  construct  feedback  gains  (6.7),  (6.8)  which  are 
guaranteed  to  provide  both  robust  stability  and  performance.  Future  research  is  required  for 
evaluating  the  conservativeness  of  the  theory.  The  numerical  algorithms  developed  in  [10]  provide 
a  starting  point  in  this  regard. 
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The  Optimal  Projection  Equations  for  Reduced-Order 
State  Estimation:  The  Singular  Measurement 
Noise  Case 

WASSIM  M.  HADDAD  and  DENNIS  S.  BERNSTEIN 

Dedicated  to  the  memory  of  Professor  Violet  B.  Haas 
November  23,  1926-January  21,  1986 

Abstract— The  optimal  projection  equations  for  reduced -order  (tale 
estimation  are  generalized  to  allow  for  singular  (i.e.,  colored)  measure¬ 
ment  noise.  The  noisy  and  noise-free  measurements  serve  as  inputs  to 
dynamic  and  static  estimators,  respectively.  The  optimal  solution  is 
characterized  by  necessary  conditions  which  involve  a  pair  of  oblique 
projections  corresponding  to  reduced  estimator  order  and  singular 
measurement  noise  intensity. 

1.  Introduction 

It  has  recently  been  shown  [  I  ]  that  solutions  to  the  steady-state  reduced- 
order  state-estimation  problem  can  be  characterized  by  means  of  a  system 
of  modified  Riccati  and  Lyapunov  equations  coupled  by  an  oblique 
projection.  As  in  classical  Kalman  filter  theory  (2>  however,  this  solution 
is  based  on  the  assumption  that  all  measurement-,  are  corrupted  by  white 
noise.  When  the  measurement  noise  is  singular  (i.e.,  colored),  the  optimal 
solution  cannot  be  applied  since  the  filter  gains  are  given  in  terms  of  the 
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inverse  of  the  noise  intensity  matrix.  Hence,  it  ii  not  surprising  that  a 
sizable  body  of  literature  has  been  devoted  to  the  singular  measurement 
noise  problem  in  both  continuous  and  discrete  time  [2]-[14J.  For  an 
overview  of  stochastic  observer  theory,  see  [IS], 

Much  of  the  continuous-time  singular  estimation  literature  attempts  to 
overcome  the  noise  singularity  by  introducing  new  measurements 
obtained  by  differentiating  noise-free  measurements.  The  present  note 
complements  these  results  in  the  following  way.  For  the  available  noisy 
and  noise -free  measurements  we  simultaneously  design  a  reduced-order 
dynamic  estimator  for  the  noisy  measurements  and  a  static  estimator  for 
the  noise-free  measurements.  We  are  not  concerned  here  with  the 
question  of  how  the  measurements  are  generated  (e.g.,  via  successive 
differentiation).  Rather,  our  goal  is  to  develop  a  unified  dynamic/ttatic 
estimation  design  theory  which  permits  full  utilization  of  both  noisy  and 
noise-free  measurements.  Application  of  these  results  to  previously 
proposed  approaches  to  singular  estimation  involving  differentiation  and 
transformation  should  be  an  interesting  area  for  future  research. 

The  results  given  herein  directly  generalize  the  results  obtained  in  [1], 
Specifically,  the  modified  Riccati/Lyapunov  equations  are  now  coupled 
by  a  pair  of  oblique  projections.  As  in  [1]  the  requirement  for  reduced 
estimator  order  gives  rise  to  the  projection 

r t-QPiQfiy  (i.i) 

where  (  )*  denotes  group  generalized  inverse  and  Q  and  P  are  rank- 
deficient  nonnegative-definite  matrices  analogous  to  the  controllability 
and  observability  Gramians  of  the  estimator.  In  addition,  the  presence  of 
noise-free  measurements 

y(r)-C2x(r)  (1.2) 

leads  to  the  projection 

T,-QC1r(C2gCf)-'C,  (1.3) 

where  Q  is  the  steady-state  error  covariance.  The  contribution  of  the 
present  note  is  a  concise,  unified  statement  of  the  optimality  conditions  in 
a  form  which  clearly  displays  the  role  of  the  oblique  projections  rt  and  r2 
in  explicitly  characterizing  optimal  static/dynamic  (nonstrictly  proper) 
estimators.  An  additional  feature  of  the  present  note  is  the  presence  of 
state-  and  measurement-dependent  white  noise  in  the  plant  model.  This 
model  has  been  studied  in  a  state-estimator  context  in  (16]-[18]  has 

been  justified  as  an  approach  to  robustness  in  [19]~[22]. 

In  Section  III  of  the  note,  we  consider  the  case  in  which  the  noisy  and 
noise-free  measurements  are  fed  to  the  dynamic  and  static  estimators, 
respectively.  In  Section  IV,  we  note  that  feeding  the  noisy  measurements 
to  the  static  estimator  results  in  an  ill-posed  problem,  and  we  consider  the 
general  case  in  which  the  noise-free  measurements  are  fed  to  both  the 
static  and  dynamic  estimators.  Optimality  conditions  now  lead  to  the 
interesting  disjointness  condition 

0  =  r2r,  (1.4) 

concerning  the  relationship  between  the  static  and  dynamic  estimators. 
The  meaning  of  (1.4)  for  proposed  singular  estimation  schemes  will  be 
explored  in  future  papers. 

The  goal  of  this  note  is  confined  to  a  rigorous  development  of  necessary 
conditions  for  the  optimal  estimation  problem.  In  support  of  this  aim  it 
should  be  noted  that  the  usefulness  of  necessary  conditions  in  optimization 
and  optimal  control  has  been  amply  demonstrated  by  classical  results  such 
as  the  maximum  principle  and  Euler- Lagrange  theory.  For  practical 
purposes,  necessary  conditions  are  largely  free  from  restrictive  special 
assumptions  which  invariably  accompany  sufficiency  theory.  Most 
importantly,  success  in  addressing  the  problems  of  existence,  sufficiency 
and  global  optimality  is  hr  more  likely  after  the  full  elucidation  of  the 
necessary  conditions  has  been  achieved.  Indeed,  sufficiency  conditions 
are  often  obtained  by  strengthening  necessary  conditions  by  means  of 
additional  restrictive  assumptions. 

Even  without  a  complete  resolution  of  questions  pertaining  to  existence 
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and  sufficiency,  the  necessary  conditions  fulfill  several  immediate  needs. 
Specifically,  the  structure  of  these  conditions  provides  insight  into  the 
properties  of  the  solution  arising  from  optimality  considerations.  This  has 
been  demonstrated  for  the  closely  related  problem  of  reduced-order 
modeling  for  which  local  minima  are  characterized  in  terms  of  an 
eigensysiem  decomposition  [23],  Potentially  more  useful  than  insight  for 
practical  applications  are  prospects  for  constructing  novel  computational 
algorithms  which  avoid  traditional  gradient  search  methods.  Thus  far,  two 
distinct  algorithms  have  been  developed,  namely,  an  iterative  method 
which  exploits  the  structure  of  the  oblique  projection  [23]  and  a  homotopy 
algorithm  which  eliminates  the  need  for  eigensystem  calculations  and 
provides  the  means  for  attaining  global  optimality  [24],  For  computational 
purposes  it  should  also  be  noted  that  under  an  existence  assumption  the 
necessary  conditions  are  guaranteed  to  possess  a  solution  to  the  problem, 
while  sufficient  conditions  may  fail  in  this  regard. 


m.  Problem  Statement  and  Main  Theorem 
Reduced-Order  State-Estimation  Problem 
Given  the  nth -order  observed  system 


(a  +  ^vXDA^  xft)+w»{t). 

01) 

(ci+i  u,{t)Cuj  xtn+WiO). 

0-2) 

y2(/)“C,x(f). 

0-3) 
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(  )r.  (  )* 
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asymptotically  stable  matrix 
nonnegative-semisimple  matrix 
nonnegative-definite  matrix 
positive-definite  matrix 


n.  Notation  and  Definitions 

real  numbers,  r  x  s  real  matrices,  38'*1.  expectation 
n  x  n  identity,  transpose,  group  generalized  inverse  [25,  p.  124] 
Kronecker  sum,  Kronecker  product  [26] 
trace  of  a  square  matrix  Z 

i.  -  t,  r  e  r**» 

positive  integers,  1  S  n,  s  n 
n+n, 

n,  /1,-dimensional  vectors 
/i,  /j,  <j -dimensional  vectors 
n  x  n  matrices;  l\  x  n  matrices,  /  »  1,  ••*,/» 
l}  x  n  matrix 

n,  x  n,,n,x  l\,q  x  n„  q  x  /2  matrices 
unit  variance  white  noise,  i  -  1,  •  •  -,  p 
n -dimensional,  ^-dimensional  white  noise  processes 
n  X  n  nonnegative-definite  intensity  of  w0(f) 

/i  X  /|  positive-definite  intensity  of  w,(t) 
n  x  /|  cross  intensity  of  w0(r),  M>i(r) 
q  x  q  positive-definite  matrix 
q  x  n  matrix 


\a  ol 

r*  oi 

[ac,  a.  J 

'  \_B.Cu  Oj 

n,  x  /}  matrix 

r  „  .] 

L  B£i  +  KC>  A.  J 

f  w0 (0  1 

|_4f.w,(/)  J 

r  K  1 

IB,  VI  B.V,Bi  J 

* 

\  L  rRL  - L TRD,Ci  -  CIDT,RL  +  C3r£»;/?D.C,  - L TRC,  +  CJDJRC,  1 
[  -  CfRL  +  C]RD,Ci  C^RC,  J 


matrix  with  eigenvalues  in  open  left-half  plane 
semisimple  (nondefective)  matrix  with  nonnegative  eigenvalues 
symmetric  matrix  with  nonnegative  eigenvalues 
symmetric  matrix  with  positive  eigenvalues. 


For  ^bitrary  n  x  n  Q,  Q  define: 

V»  A  K,+  J  CuiQ*C)CTu. 

4*1 

a  a  ocf+K,,+£i4l(Q+$>cr,, 

4-1 

Aq  A  A-Q.VjCi. 


where  t  €  [0,  o» ),  design  an  n,th -order  state  estimator 

M0-Apc,(t)  +  B.yl(t),  0-4) 

>,(/)- C-n(/)+D,yj(/)  0.5) 

which  minimizes  the  state-estimation  error  criterion 

J(A„  B„  C„  D.)  A  Um  B[Lx{t)-ymTR[Lx{t)-y.(t)].  0.6) 
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To  guarantee  that  J  is  finite,  assume  that  A  is  asymptotically  stable  and 
consider  die  set  of  asymptotically  stable  reduced-order  (i.e.,  fixed-order) 
estimators 

A  A  {(A„  Bt,  C„  D ,) :  A,  is  asymptotically  stable). 

Since  the  value  of  J  is  independent  of  the  internal  realization  of  the 
transfer  function  corresponding  to  (3.4)  and  (3.3),  without  loss  of 
generality  we  further  restrict  our  attention  to  the  set  of  admissible 
estimators 

A*  A  {( A „  B„  C„  Dt)€  A  :  ( A„  B ,)  is  controllable 
and  (A„  C,)  is  observable). 

An  additional  technical  requirement  is  that  (A„  B„  C„  D,)  be  confined  to 
the  set 

A*  A  {(A,,  B„  C„  Dr)  e  A *  : 

Ci(Q,  -QuOj'CfjlCJ  is  positive  defi.ute), 

where 

o 6  [«  ft]  e 

satisfies 

O-AQ+QAr+'^A&Af+P 

/-I 

and  Qi  is  invertible  since  (A„  Br)  is  controllable.  The  positive 
definiteness  condition  holds  when  Cj  has  full  row  rank  and  Q  is  positive 
definite.  As  can  be  seen  from  the  proof  of  Theorem  3.1,  this  condition 
implies  the  existence  of  the  projection  r,  defined  below. 

The  following  factorization  lemma  is  needed  for  the  statement  of  the 
main  result. 

Lemma  3.1:  Suppose  ft  x  n  Q,  P  are  nonnegative  definite.  Then  QP 
is  nonnegative  semisimple.  If,  in  addition,  rank  QP  *  n„  then  there  exist 
ft,  x  n  Gy  T  and  n,  x  n,  invertible  M  such  that 

QP*GTMT,  (3.7a) 

rcr-/.,.  (3.7b) 

Furthermore,  G,  M,  and  T  are  unique  modulo  a  change  of  basis  in 

Proof:  The  result  follows  from  [27,  Theorem  6.2.5).  □ 

Since  QP  is  semisimple  (diagonalizabte)  it  has  a  group  generalized 
inverse  (QP)’  ~  G TM ~  T  and 

tj  A  QPlQP)’~GT r  (3.8) 

is  an  oblique  projection. 

Theorem  3.1:  Suppose  A  is  asymptotically  stable  and  (A„  B„  C„  D,) 
€  A*  solves  the  reduced-order  state-estimation  problem.  Then  there 
exist  n  x  n  nonnegative-definite  matrices  Q,  Q,  and  P  such  that  A, ,  B„ 
C„  and  D,  are  given  by 

A.=  T(A-Q,Vu'ci)GT,  (3.9) 

B,  =  TQ,v;,\  (3.10) 

C, «LruGr.  (3.11) 

*  D.=LQCl(C,QCP'  (3.12) 

and  such  that  Q,  Q,  and  P  satisfy 

0  •AQ  +  QAr+jriAl(Q+Q)Ar+  Vt- Q,v;,'QJ+tu  Q,  , 

1- I 


0 -  AQ  +  QA  a  V  - 1 1 QJ- Ttx  Q,  V  - 1 1 Q] T .  (3.14) 

0  -  A  /»A0+  £  TRLr,  a  -  r'  t^LtRLt,  a  ,  (3.15) 

rank  Q- rank  £=rank  Qpmn,  (3.16) 

where 

r,  A  QC[(C1(2C[)->Ct.  (3.17) 


Remark  3.1:  Several  special  cases  can  be  recovered  from  Theorem 
3.1.  For  example,  when  the  observation  noise  is  nonsingular,  i.e.,  when 
yi  is  absent,  delete  (3.12)  and  set  r,  «  0  [22].  Deleting  also  the 
multiplicative  noise  terms  yields  the  Main  Theorem  of  [1). 

Specializing  Theorem  3. 1  to  the  full-order  case  n,  «  n  reveals  that  the 
Lyapunov  equation  for  P  is  superfluous.  In  this  case  G  =  T  * 1  and  thus  G 
«  T  *  /„  without  loss  of  generality. 

Corollary  3. 1:  Assume  n,  =  n,  A  is  asymptotically  stable  and  (A„  B„ 
C„  D,)  6  A  *  solves  the  full-order  state-estimation  problem.  Then  there 
exist  n  x  n  nonnegative-definite  matrices  Q  and  Q  such  that  A„  B„  C„ 
D,  are  given  by 


A.~A-Q,v;l'c„ 

(3.18) 

B.-Q.VJ, 

(3.19) 

C,»Ar  ix. 

(3.20) 

D.-LQC^CiQClY' 

(3.21) 

and  such  that  Q  and  Q  satisfy 

0 «AQ+GA'  +  £  A,(C+<J)A;+  vt-Q,v;t'Qj. 

/-I 

(3.22) 

0-aQ+Qat+q,v-u'qt. 

(3.23) 

Remark  3.2:  Note  that  by  setting  A,  ■  0,  C,  ■  0,  i  «  1 ,  •••,/?,  it 
follows  that  (3.22)  and  (3.23)  are  decoupled  and  (3.23)  is  superfluous.  To 
recover  the  standard  Kalman  filter  which  involves  nonsingular  noise,  set 
C2  «  0,  delete  (3.21)  and  define  t,  -  0. 

IV.  additional  Estimator  Paths 

We  now  consider  the  more  general  estimator 

X,(t)  -  A,x,(r)  +  B.y,  (/)  +  Ky2(t), 

(4.1) 

y,U)  -  Or, + D,y2(t) + J?>i  (0 

(4.2) 

involving  the  additional  gains  K  and  R. 

Note  that  the  additional  path  introduced  in  (4.2)  implies  that  J  is  infinite 
and  thus  the  problem  is  meaningless.  Hence,  set  R  «  0,  and  consider  the 
additional  path  introduced  by  (4.1),  i.e.,  filtering  the  noise-free  measure¬ 
ment. 

Replacing  (3.4)  by  (4.1)  and  optimizing  with  respect  to  K  yields 

o=gPqct2, 

(4.3) 

which  implies 

0-TjT,. 

(4.4) 

Using  (4.3),  Q  m  rj Q  and  P  *  Ptj  [see  (5.17)],  the  filter  gains  (3.9)- 
(3.15)  become 

A,- T(A  -  Q,  V'U'C,)GT- KCiGT, 

(4.5) 

A-r&K-/. 


(3.13) 


(4.6) 


C,mLruOT, 

D.-lQC'&QCp-', 

0-AQ+QAt+£  AAQ+OiAf 
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(4.7)  and  the  n,  x  n,  n,  x  n,,  n,  x  n  matrices  | 

(4.8)  „  G  k  Q2'Q\2,  M  k  Q1P1,  T  k  -P;'PTa. 

To  optimize  (3.6)  subject  to  the  constraint  (3.4)  over  A* ,  form  the! 
Lagrangian  I 

HA.,  B„  C„  D„  C,  P,  X) 


*yt-Q.y:;Q:+rl±Q.v;;Q:ril,  (4.9)  r  /  \ 

,  ,  k  tr  \GP  +  ( AQ  +  QAT+  V  A,GAl+  9\P\m 

0-AQ+QAr+  Q,Vu'Q;- QJ^  - QC^G-G^KCiQ.  L  \  m 

(4. 10)  where  the  Lagrange  multipliers  X  fc  0  and  P  €  are  not  both  zero 
„  .  r, ,  t  r  tr..  ...  and  Q  and  P  are  viewed  as  arbitrary  H  x.  ft  matrix  variables.  Setting  BL/M 

0~AIP+PAq+tixL  RLt,2  T11Tl XL  RLtxlt22.,  (4.11)  gg  »  o,  X  «  0  implies  P  *  0  since  ( A „  fl„  C„  /),)  €  >4  V  Hence,| 

^  without  loss  of  generality,  set  X  =  I.  Thus,  the  stationarity  conditions  are 

given  by 1 

A  k  A-GtKCi,Aq  k  Ae-GTXC2.  ..  ,  I 

jp-AQ+  QAT+  £  A.QA^  P=o.  (3.6)| 

v.  Proof  of  the  Main  Theorem  <- 1 


Using  the  notation  of  Section  Q  the  augmented  system  <3. 1 )— (3.4)  can 
be  written  as 


i(r)«  vXOA^j  m+  MD 


^ATP*PA^AJPA^P‘0, 

0, 


m  k  ix  r(r),  *;(/)] r. 

To  analyze  (3.1)  define  the  second-moment  matrix 

<2(0-«[*«)jer(/)l 

It  follows  from  128,  Theorem  8.3.3,  p.  142]  that  Q(t)  satisfies 


H-«(/,r2<2.+*Qr1>cr+E  (^G-cr, 


+  PiB.CuQx  Cfi)  +  P\ \  Vo,  +  PiB,  K,  •  0.  (5.9)  | 
~~  - RLQn  +  RD,C2Q,t  +  0,  (5. 10) 

—  - RLQX Cf+  RD'CiQ, Cf  +  RC.Q^C^O.  (S.ll)  | 


e(i)=AQU)+Q(r)AT+%A&t)Al+P,  13: 0.  (5.3)  Expanding  (5.6)  and  (5.7)  yields 

.tl..i.8i  if  end  nnlv  if  0-/10,  +  Q,A '+  £  A,QXAJ+  V„ 


Lemma  5.1:  A.  €  A  if  and  only  if 

A  kA^A+^A^A, 


0  =  AQl2  +  QlClBl+Q„At+'2AlQ,CllB;+  V^B],  (5.13)1 


is  asymptotically  stable.  jl 

Proof:  The  result  follows  from  properties  of  the  Kronecker  product  0 * B*C'QT\i + A*Qi +  Q uc[^r+  CM  2  . 

applied  to  partitioned  matrices.  See  [22],  [26]  for  details.  □ 

Hence,  A  stable  assures  <514) 


(J  A  Um  «(J?(f)*r(0J  0*A  TPxi  +  C\BTP2  +  PnA,~  L  TRC.  +  CjDjRC, ,  (5.15) 

_  0-A;P,  +  Pa^,+  C,r«C,.  (5.16) 

exists.  Furthermore,  0  and  its  nonnegative-definite  dual  P  are  unique 

solutions  of  the  modified  Lyapunov  equations  «  Note  that  the  (1 ,  1)  subblock  of  (5.7)  characterizing  P,  has  been  omitted 

from  the  above  equations  since  the  estimator  gains  are  independent  of  Px. 
rs.srr.f  r  srr  .  o  ....  Note  «•«  <5.8)  implies  (3.7a)  and  (3.7b).  Since 


t  *  (5.4)  Note  **  <5  8)  impli“  (3  7i)  •nd  (3  7b)-  Since 

ft*  -  P;  'n(P'2nQiP'2')P'2\ 

P 

0~ATP+PA+  ^  'iJ’PAi+P.  (5.5)  positive  semisimple.  Sylvester’s  inequality  yields  (3.16).  Note  also 

'*■  that 

Partition  ft  x  A  Q,  P  into  n  x  n,  n  x  n,,  and  n,  x  n,  subblocks  as  rs  171 


and  define  the  n  x  n  nonnegative-definite  matrices 
Q  k  Q,-QnQi'Q], /»  6 

0  k  QaQi'QTa.  P  k  P»P;'Pr„ 


(J-Tjf?.  P-Pt2.  (5.17) 

Next  (3. 10),  (3. 1 1),  and  (3. 12)  follow  from  (5.9),  (5. 10),  and  (3. 1 1)  by 

1  As  riuwn  hi  [29],  the  formula  for  the  derivative  of  a  scalar  function  with  reaped  to 
lymmetric  arguments  Q  and  P  entails  a  modification  of  (5.6)  and  (3.7).  Since  dmae 
(radiants  ere  beia|  set  to  rero,  however,  the  ftml  result  is  identical.  Alternatively,  Q  end 
P  can  be  viewed  (as  we  are  doing  hen)  at  arbitrary  metris  variables  Symmetry  it 
imposed  only  •  pontrmri  by  die  form  of  (5.4)  end  (5.5)  and  the  debility  of  A  Hence, 
■■rtirmetirill]  the  result  of  (29)  it  not  required. 
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using  the  identities 

(26) 

q,«G+<2.  />,-/»+/* 

(5.18) 

(27) 

Gu«<5rr,  Pn~-PCT, 

(5.19) 

(28) 

a- rQrr.  p,‘OfiGT. 

(5.20) 

(291 

Substituting  (3.10),  (3.11),  (3.12)  snd  (5.18H5.20)  into  (5.12M5.16) 
and  using  (5.12)  +  GTXS.ISJG  -  (5.13)G  -  (5.13G)r  and 
GTXS.UIG  -  (5.13)G  -  (5.13G)r  yields  (3.13)  and  (3.14).  Using 
rrG(5.15)r  -  (5.15)r  -  (5.1jr)r  yields  (3.15).  Finally,  T(5.13h 
(5.14)  or  C(5.15H5.16)  yields  (3.9).  □ 

Remark  5.1.  Equations  (4.5)— (4. 11)  are  derived  in  a  similar  manner 
with  A  replaced  by  A  in  (5.1). 

References 

(1)  D.  S.  Benutein  and  C.  D.  Hyland,  "The  optimal  projection  equations  for  reduced- 
Ofder  state  estimation."  IEEE  Trans.  Automat.  Contr.,  vol.  AC -30.  pp.  583- 
$85.  1983. 

(2)  H.  Kwakemaxk  and  R.  Sivan.  Linear  Optimal  Control  Systems.  New  York: 
Wiley.  1972. 

(3)  A.  E.  Bryson  and  D.  E.  Johansen.  “Linear  filtering  for  time  varying  systems  using 
measurements  containing  colored  noise."  IEEE  Trans.  Automat.  Contr.,  vol. 
AC-10,  pp.  4-10.  1965. 

(4)  E.  Fogel  and  Y.  F.  Huang.  "Reduced  order  optimal  state  estimator  for  linear 
systems  with  partially  noise-corrupted  measurements,"  IEEE  Traru.  Automat. 
Contr.,  vol.  AC-25,  pp.  994-996,  1980 

(5)  Y.  T.  iu  and  V.  B.  Haas.  “A  duality  principle  for  state  estimation  with  partially 
noise-corrupted  measurements."  Int.  J.  Contr.,  vol.  37,  pp.  1039-1056.  1983. 

(6)  U.  Shaked.  “Optimal  nearly  singular  estimation  of  continuous  linear  stationary 
uniform  rank  systems."  Int.  J.  Contr.,  vol.  38,  pp.  275-311,  1983. 

(7)  V.  B.  Haas.  “Reduced  order  state  estimation  for  a  linear  system  with  exact 
measurements."  Automation,  vol.  20,  pp.  223-229,  1984. 

(8)  U.  Shaked.  “Explicit  solution  to  the  singular  discrete-time  stationary  linear 
filtering  problem,"  IEEE  Trans.  Automat.  Contr.,  vol.  AC-30,  pp.  34-47, 
1985. 

(9)  V.  B.  Haas.  "Minimal  order  Wiener  filter  for  a  system  with  exact  measure¬ 
ments."  IEEE  Trans.  Automat.  Contr.,  vol.  AC-30,  pp.  773-776,  1985. 

(10)  i.  M.  Schumacher,  “A  geometric  approach  to  the  sin^tlar  filtering  problem," 
IEEE  Trans.  Automat.  Contr.,  vol.  AC-30,  pp.  1075-1082.  1985. 

(11)  F.  W.  Fairman  and  L.  Luk,  "On  reducing  the  order  of  Kalman  filters  for  discrete¬ 
time  stochastic  systems  having  singular  measurement  noise,"  IEEE  Trans- 
Automat.  Contr.,  vol.  AC-30,  pp.  1150-1152.  1985. 

(12)  Y.  Halevi  and  Z  I.  Palmor,  "Extended  limiting  forms  of  optimum  observers  and 
LQG  regulators."  Ini.  J.  Contr.,  vol.  43,  pp  193-212,  1986. 

(I3|  U.  Shaked  and  B.  Priel.  "Explicit  solutions  to  the  singular  discrete  finite-time 
linear  estimation  problem."  Int.  J.  Contr.,  vol.  43.  pp.  285-303,  1986. 

(14)  W.  M.  Haddad  and  D.  S.  Bernstein.  “The  optimal  projection  equations  for 
reduced-order,  discrete-time  state  estimation  for  linear  systems  with  multiplicative 
white  noise."  Syst.  Contr.  Lett.,  vol.  8.  pp.  381-388.  1987. 

1 15)  J  O'^etWy .  Observers  for  Linear  Systems.  New  York.  Academic,  1983. 

(I6|  P.  J.  McLanc.  "Optimal  linear  filtering  for  linear  systems  with  state-dependent 
noise."  Int.  J.  Contr.,  vol.  10.  pp  42-51.  1969 
(17)  R.  B  Asher  and  C.  S.  Sims.  "Reduced-order  filtering  with  state  dependent 
noise."  in  Proc.  Joint  Amer.  Contr.  Conf.,  1978 
(l*|  M  1  Grintblc,  "Wiener  and  Kalman  filters  for  systems  with  random  parame¬ 
ters."  IEEE  Trans.  Automat.  Contr..  vol.  AC-29,  pp.  552-554,  1984 
II9|  D  S  Bernstein  and  D.  C.  Hyland.  "The  optimal  projection/maximum  entropy 
approach  to  designing  low-order,  robust  controllers  for  flexible  structures.  "  in 
Proc.  24th  IEEE  Conf.  Dec.  Contr.,  Fort  Lauderdale,  FL,  Dec.  1985,  pp.  745- 
752. 

(20|  D  S  Bernstein  and  S  W.  Greeley.  “Robust  controller  synthesis  using  the 
maximum  entropy  design  equations."  IEEE  Trans ,  Automat.  Contr.,  vol.  AC- 
31.  pp  362-364.  1986 

(2I|  D.  S.  Bernstein  and  S  W.  Greeley.  "Robust  output-feedback  stabilization 
Deterministic  and  stochastic  perspectives,"  in  Proc.  American  Contr,  Conf., 
Seattle.  WA.  June  1986,  pp  1818-1826 

(22|  D  S.  Bernstein  and  D  C.  Hyland.  "The  optimal  projection  equations  for  reduced- 
order  modelling,  estimation  and  control  of  linear  systems  with  multiplicative  white 
noise."  J.  Optima  Theory  Appl  .  to  be  published. 

(23)  D.  C.  Hyland  and  D.  S.  Bernstein,  "The  optimal  projection  equations  for  model 
reduction  and  the  relationships  among  the  methods  of  Wilson,  Skelton  and 
Moore."  IEEE  Trans.  Automat.  Contr.,  vol.  AC-30,  pp.  1201-1211,  1985. 

(24)  S.  Richter,  “A  homotopy  algorithm  for  solving  the  optimal  projection  equations 
for  fixed-order  dynamic  compensation:  Existence,  convergence  and  global 
optimality,”  in  Proc.  Amer.  Contr.  Conf.,  Minneapolis,  MN,  June  1987,  pp. 
1527-1531. 

(25)  S.  L.  Campbell  and  C.  D.  Meyer.  Jr.,  Generalized  Invents  of  Linear 
Transformations.  London:  Pitman,  1979. 


J.  W.  Brewer,  “Kronecker  products  and  matrix  calculus  in  system  theory,"  IEEE 
Trans.  Circuits  Syst.,  vol.  CAS-25,  pp.  772-781,  1978. 

C.  R.  Rao  and  S.  K.  Mitre.  Generalized  Inverse  of  Matrices  and  Its 
Applications.  New  York:  Wiley,  1971. 

L.  Arnold.  Stochastic  Differential  Equations:  Theory  and  Applications. 
New  York:  Wiley,  1974. 

J.  W.  Brewer,  "The  gradient  with  reaped  to  a  symmetric  matrix."  IEEE  Trans. 
Automat.  Contr.,  vol.  AC-22,  pp.  265-267,  1977. 


0018-9286/87/1200-1 13( 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL,  VOL.  AC-32.  NO.  12,  DECEMBER  1987 


1139 


•  i.  \-jnp_g 


The  Optimal  Projection  Equations  for  Static  ana  — 
Dynamic  Output  Feedback:  The  Singular  Case 

DENNIS  S.  BERNSTEIN 

Dedicated  to  the  memory  of  Professor  Violet  B.  Haas 
November  23,  1926-January  21,  1986 

Abstract — Oblique  projections  have  been  shown  to  arise  naturally  in 
both  static  and  dynamic  optimal  design  problems.  For  static  controllers 
an  oblique  projection  was  inherent  in  the  early  work  of  Levine  and 
Athans,  while  for  dynamic  controllers  an  oblique  projection  was 
developed  by  Hyland  and  Bernstein.  This  note  is  motivated  by  the 
following  natural  question:  What  is  the  relationship  between  the  oblique 
projection  arising  in  optimal  static  output  feedback  and  the  oblique 
projection  arising  in  optimal  fixed-order  dynamic  compensation?  We 
show  that  in  aonttrictiy  proper  optimal  output  feedback  there  are, 
indeed,  time  distinct  oblique  projections  corresponding  to  singular 
measurement  noise,  singular  control  weighting,  and  reduced  compensator 
order.  Moreover,  we  unify  the  Levine-Athans  and  Hyland-Bernstein 
approaches  by  rederiving  the  optimal  projection  equations  for  combined 
static/dynamic  (nonstrictly  proper)  output  feedback  in  a  form  which 
dearly  illustrates  the  role  of  the  three  projections  In  characterizing  the 
optimal  feedback  gains.  Even  when  the  dynamic  component  of  the 
nonstrictly  proper  controller  Is  of  full  order,  the  controller  is  character¬ 
ized  by  four  matrix  equations  which  generalize  the  standard  LQG  result. 

I.  Introduction 

The  optimal  static  output-feedback  problem  [1],  [2]  and  the  optimal 
fixed-order  dynamic-compensation  problem  [3],  [4]  have  been  exten¬ 
sively  investigated.  A  salient  feature  of  the  necessary  conditions  for  each 
of  these  problems  is  the  presence  of  an  oblique  projection  (idempotent 
matrix)  which  arises  as  a  direct  consequence  of  optimality.  For  the  static 
problem  with  noise-free  measurements  (i.c..  singular  measurement  noise) 
the  necessary  conditions  involve  the  projection  12] 

T,~QCTiCQCT)  'C 

where  Q  is  the  steady-state  closed-loop  state  covariance.  The  dual 
projection 

t2  =  B(BtPB)'BtP 

arises  analogously  in  the  corresponding  problem  involving  singular 
control  weighting.  Furthermore,  for  fixed-order  dynamic  compensation 
with  noisy  measurements,  it  has  recently  been  shown  |4]  that  the 
necessary  conditions  give  rise  to  the  projection 

r2~QP(QPY 

where  ( )#  denotes  group  generalized  inverse  and  Q  and  P  are  rank- 
deficient  nonnegative-definite  matrices  analogous  to  the  controllability 


Manuscript  received  February  6.  1986;  revised  November  23.  1986  and  May  3.  1987. 
This  wort  was  supported  in  pert  by  the  Air  Force  Office  of  Scientific  Research  under 
Contracts  AFOSR  F4962O-84-C-00I5  end  F49620-86-C-0002. 

The  author  is  with  the  Harris  Corporation,  Government  Aerospace  Systems  Division. 
Melbourne.  FL  32902. 

IEEE  Log  Number  8716139. 


I9S01.00  ©  1987  IEEE 


1140 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL.  VOL.  AC-32.  NO.  12.  DECEMBER  19*7 


and  observability  Gramians  of  the  compensator.  To  understand  the 
relationships  among  r,,  t2,  and  r3,  the  contribution  of  the  present  note 
is  a  unified  treatment  of  the  necessary  conditions  for  optimal  static/ 
dynamic  feedback  compensation  which  dearly  illustrates  the  role  of 
the  three  projections  in  characterizing  the  optimal  feedback  gains. 
Even  in  the  full-order  case  in  which  r3  is  the  identity,  the  result  provides 
a  generalization  of  the  standard  LQG  result  to  nonstrictly  proper 
controllers  in  which  case  the  separation  principle  does  not  hold. 

To  clarify  the  ramifications  of  noise  and  weighting  singularities  in 
optimal  output  feedback,  consider  the  problem  of  minimizing 


lim  I(xrA#jr+urA|«<] 

<-• 

(1.1) 

with  plant  dynamics 

J t"Ax+Bu+w0, 

0-2) 

y  =  Cx+  W|, 

(1.3) 

and  nonstrictly  proper  feedback  compensator 

.  j tc~AcXc+Bcy, 

(14) 

U*CcXe  +  Dcy. 

(1.5) 

As  pointed  out  in  [3],  J  is  finite  only  if 

O-trlDfA.Ak'.l  •  0-A.AK, 

(1.6) 

where  V\  denotes  the  intensity  of  wt.  Clearly,  when  A,  and  V,  are 
nonsingular  (1.6)  implies  Dcm 0,  and  hence  direct  feedthrough  is  not 
permitted,  i.e.,  the  compensator  must  be  strictly  proper.  Conversely,  to 
utilize  a  static  gain  D„  either  A,  or  V,  must  be  singular.  By  writing 
singular  At  and  V\  without  loss  of  generality  as 

»-[*:]  •«-[*:] 

it  follows  that  the  static  transmission  between  noisy  measurements  and 
weighted  controls  must  be  zero  (see  Fig.  1). 

The  reader  will  observe  that  three  feedback  paths  which  are  not  ruled 


Fig.  I. 


out  by  (1.6)  do  not  appear  in  Fig.  1.  Specifically:  1)  nonnoisy 
measurements  can  be  fed  back  to  unweighted  controls;  2)  dynamic- 
compensator  outputs  can  be  fed  back  to  unweighted  controls;  and  3) 
nonnoisy  measurements  can  serve  as  inputs  to  the  dynamic  compensator. 
The  reason  for  considering  the  more  limited  configuration  shown  in  Fig.  1 
is  that  only  these  paths  are  explicitly  characterized  by  the  necessary 
conditions.  Hence,  for  simplicity  we  first  consider  only  the  scheme  of 
Fig.  1,  and  later  introduce  the  remaining  permissible  paths.  Interestingly, 
while  these  additional  gains  are  not  completely  determined  by  the 
necessary  conditions,  they  appear  to  play  an  important  role  in  governing 
geometric  interrelationships  among  the  three  projections. 

Two  final  comments  are  in  order.  First,  since  our  results  are  carried  out 
in  a  multiplicative  noise  setting,  we  generalize  previous  results  on  state 
feedback  [15]-[18]  and  dynamic  compensation  [9]-[ll].  The  motivation 
for  using  a  multiplicative  white  noise  model  is  to  represent  plant 
parameter  uncertainties  and  thereby  obtain  robust  controllers  [12].  Also, 
the  derivations  of  the  necessary  conditions  are  straightforward  extensions 
of  the  Lagrange  multiplier  technique  used  in  [4]  and  hence  have  been 
omitted. 


n.  NOTATION  AND  DEFINITIONS 


!W.  A'**,  IM',  t 

I, A  )r.<  )' 

<§>,  ® 

Tj. 

asymptotically  stable  matrix 
nonnegative-semisimple  matrix 
n,  i»t|,  m2,  / 1,  /j,  ne,  p 
x.  «!,  u2,  y,,  y2,  xr 
A,  A ,;  Bi,  Bn",  C|,  C|( 

Bi.  C2 

Ae,  Bc,  C„  Dr,  Ec 
v,U) 

Woit),  W|(r) 

I'd.  y, 
y<>i 

A#,  Aj 


real  numbers,  r  x  s  real  matrices,  ffi'*1,  expectation 
r  x  r  identity,  transpose,  group  generalized  inverse  [13,  p.  124] 
Kronecker  sum,  Kronecker  product 

l.  -  T,  T  €  «"»" 

matrix  with  eigenvalues  in  open  left-half  plane 

semisimple  (nondefective)  matrix  with  nonnegative  eigenvalues 

positive  integers 

n,  mi,  m2,  f2,  n ..-dimensional  vectors 

n  x  n  matrices,  n  x  m,  matrices,  lt  x  n  matrices,  i  *  1,  ■■■,  p 

n  x  mi  matrix,  f2  x  n  matrix 

nc  x  nc,  nc  x  it,  mt  x  nc,  mt  x  It,  mi  x  I,  matrices 

unit  variance  white  noise,  i  «  l,  p 

n -dimensional,  -dimensional  white  noise 

intensities  of  w0,  w,;  V0  a  0,  K,  >  0 

n  x  lt  cross  intensity  of  w0,  w, 

state  and  contro!  weightings;  A0  £  0,  R,  >  0 

n  x  m |  cross  weighting:  Ao  -  A0[A  j"'A£,  £  0 

A  +  B\D,Ci  +  BiEcCuA,  +  BuDcCi  +  BiEcCu,  i  ■  I,  •••tp 


r.fi 


A.  A, 


/.  11 
(BiEt)r  J  | 

1  I 

. 

[£]  [*S 

Ad  "i  r  /.  i 

A,  J  \_DcC,\ 

if  B,C r 

Ai  iiiC,l 

BrC,  A, 

I’L 

B'c u  0  j 
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V  f  P  VttBj+BtE'VlBt’] 

L  B'VT+B'V^E'V  BcV,Bl  J 

5  T  *  U#,Ct+(DrC1)^ICc' ] 

Lcfjr+cf/t.ACi  j 


For  arbitrary  it  X  n  Q,  P,  Q,  P,  rt,  Tt  define: 

R>.  A  *,  +  £  BTfB,,.  V„  4K,  +  j;  C1(QCf„ 

4-1  4-1 

«L  A  QCJ+  P»,  +  £  A,QC f„  <9,  A  fl[P+Rf,+  £  BTUPA„ 

4-1  4-1 

P„  A  R,  +  £  «'(£+/*)£,„  P,.  A  V,  +  £  C„(C+ (3)Cf,. 

4-  t  4- f 

4,  4  QCf+  K..  +  2  A,(Q+(J)Cj;, 

4-1 

<?,  6  £?>+ Ri  +  £  BUP+fijA,. 

4-1 

4  6  A, - />,,*  * 1 «J*.  +  rj(<!L + <3Cf) ^ u'C>f • 

Ag.  A.4-(ti1Q4-t><2CDP',C,.A* 

+  rf«J >,+BjP)TA  r>,J?  ,;'((>.+ . 
P.  A  K,-K„4>1V(ft.+(?Cr)rrf-r1(^+(3cn^r,,K»; 

+  tj(4,  +  (Jen  P  - 1 P,  P  „'(4L+  Ocf)  Sr  • 


To  develop  necessaty  conditions  for  this  problem,  Dc  and  £c  must  be 
restricted  to  the  set  of  second-moment-stabilizing  gains 

8  A  |(Otl  £,) :  A  ©  A+  ^  At  ®  A,  is  asymptotically  stable^  . 

The  requirement  (Z>„  £e)  €  8  implies  the  existence  of  the  steady-state 
closed-loop  state  covariance  Q  A  lim,..  B[x(r)x(f)r].  Furthermore,  Q 
and  its  nonnegative-definite  dual  P  are  the  unique  solutions  of  the 
modified  Lyapunov  equations 

0-/4Q+  C/P+  £  A,eA,r+  P,  (3.7) 

4-1 

0-^rP+A4+^^(rM+if.  (3.8) 

4-1 

An  additional  technical  assumption  is  that  ( Dct  Ee)  be  confined  to  the  set 

8*  A  {(A.  Et)  6  8:  C,QC[> 0  and  flJr/>B2>0}. 

In  order  to  obtain  closed-form  expressions  for  the  feedback  gains  we 
make  the  additional  assumption  here  and  in  Section  IV  that 

[BhWO-Cu-OI,  4—1,  ••*,/>,  (3.9) 

i.e. ,  for  each  /,  Bu  and  Cu  are  not  both  nonzero.  By  optimizing  (3.6)  with 
respect  to  A  and  Ec  and  manipulating  (3.7)  and  (3.8),  we  obtain  the 
following  result. 

Theorem  3.1:  Suppose  (D„  £t)  6  S*  solves  the  static  output  feedback 
problem.  Then  there  exist  it  x  n  nonnegative-definite  Q,  P  such  that 

A-  -*  r>.GCr(C»CCD-.  (3-10) 


III.  Static  Output  feedback 

£,-  - (B\PBi) ~  'B^Pth K  *  , 

(3.11) 

Sialic  Output  Feedback  Problem 

Given  the  controlled  system 

je<f)-^A  +  £i/((/)A^x(t> 

'  and  such  that  Q  and  P  satisfy 

0-(A -B,R  ;t‘<?,Tt)Q  +  Q(A -B,R  i>,T,)’  +  P„ 

+  £  (A,-BUR  -y,T,)Q{A,-B„R  ■'<P,rl)r 

4-1 

+  +  Hi (t)  +  BtUj(l)  +  wo(0. 

(3.1) 

-^.Kuor+^ft.^u  Wx. 

(3.12) 

y.  (0 = (c,  +  £  i»,(/)C,  x(f) + w,  (t). 

0  -  ( A  -  Ti  A  P  r.‘  C. )  r4»+ F(A  -  rjQ,  P  u  Cl )  +  £o 

(32) 

+  £  (A, - r2£L  V  - ' Cn)TP(Aj -  rj«L  P ,V C„) 

yj(/)-CiJr(/) 

(3.3) 

4-1 

where  t  €  (0,  — ),  determine  A  and  £c  such  that  the  static  output 

(3.13) 

feedback’Law 

u,(/)-A>i(0. 

(3A) 

where 

«j(f)-£ty,(r) 

(3.3) 

r,  A  QC^CjQCp-'Cj. 

(3.U) 

minimizes  the  performance  criterion 

mA  Bt(B;PBi)-'B;p. 

(3.13) 

J  A  lim  *(*(!)  rRtX(i)  +  2x(t)  rBo,  Hi  (r) + U|(0  rRt  Ui(r)]. 

(3.6) 

Remark  3.1:  Several  special  cases  can  be  recovered  formally  from 
Theorem  3.1.  For  example,  when  the  control  weighting  is  nonsingular 
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and  the  measurement  noise  is  zero,  i.e.,  when  and  .ft  are  absent,  delete 
(3.11)  and  set  r2«0.  Deleting  also  the  multiplicative  noise  terms  yields 
the  usual  static  output  feedback  result  [1],  [2], 

IV.  Dynamic  Output  Feedback 

We  now  expand  the  formulation  of  the  static  problem  to  include  a 
purely  dynamic  (strictly  proper)  dynamic  compensator. 

Dynamic  Output  Feedback  Problem 

Given  (3.1M3.3),  determine  A„  Bc,  C„  Dc,  Ec  such  that  the  static  and 
dynamic  output  feedback  law 


P,  Q,  P  such  that 


Ac  -  T(A  -  A,  A  -  ft.  9  - '  C,  )GT, 

(4.10) 

A-r(rJ1ft,-r1(JC’)f>-', 

(4.11) 

C,m  -  A  ^'((S’.Tu  -BjPrt)GT, 

(4.12)  j 

Dt~ -A  ■'«?,+ B[P)QC'(CjQC[)-‘, 

(4.13) 

Ec * -(BlPB2)-'BlP(£i,  +  0Cl)9;,1 

(4.14) 

kef*)  m  AcXc(t)  +  B,yx  (t). 

(4.1) 

u,  (0  *=  CeXc(t)  +  Dcyi(t), 

(4-2) 

ui(t)-Ecyx(t) 

(4.3) 

minimizes  the  performance  criterion  (3.6). 

We  restrict  our  attention  to  second-moment-stabilizing  controllers 

J)  A  j  (A,,  Be,  Ce,  Dc,  Ee):A®A  +  '%lA,®At  is 

V  <»l 

asymptotically  stable  and  (Aei  BCt 

Cc)  is  minimall  , 

which  implies  the  existence  of  <3  A  lim,_„  J[i(r)?(r)r),  where  f(/)  A 
(x(t)T,  xA0r)T.  Furthermore,  Q  and  its  dual  P  ate  the  unique  solutions 
of  the  modified  Lyapunov  equations 

0-^Q+fiJt r+  £  A,QAf+  V, 

/•I 

(4.4) 

*  -  A  2-2  2 

0~ATP+PA  +  ^  AjPAg  +  R. 

<- 1 

(4.5) 

Partitioning 


r o.  an  p=\ p'  pui 
Lor:  02 J  ■  L n  ftj* 


where  Qn  and  P l2  are  n  x  nc,  we  also  require 

J>*  A  {(/!„  Be,  Ce.  Dc,  Er)  €  33  :  C:U?,-G,jG,-,<?f:)Cr>0 

and  BliP^PnP-'P^B^O). 


Optimizing  (3.6)  over  33* ,  introducing  new  variables 

Q  *  Qt-QaQi'Qir  P  A  Pt-PaP^pr,  (4.6) 

0  *  QuQl'Ql,.  PiPaP;'PTn.  (4.7) 

and  manipulating  (4.4)  and  (4.S).  we  obtain  the  dynamic  extension  of 
Theorem  3.1-  The  following  lemma  is  required  for  the  statement  of  the 
result. 

Lemma  4.1:  Suppose  n  x  n  Q,  P  are  nonnegative  definite.  Then  QP 
is  nonnegative  semisimple.  If,  in  addition,  rank  QP  =  nc,  then  there  exist 
nc  x  n  G,  T  and  nc  x  nc  invertible  M  such  that 


where  T|  and  t2  are  given  by  (3.14)  and  (3.15),  G,  T  satisfy  (4.8a), 
(4.8b),  and  such  that,  with  r,  given  by  (4.9),  Q,  P,  0,  and  P  satisfy 

0 •AQ+  QA t+  90  +  £  [A.QAJ*  ( A,-B„A  * ' [<?,Ti ,  - B\Pr, ]) 

im  1 


•  Q(A,-BUA  x  - B]PtA) r]  -  (r2i  ft,  -  TiGCf) ? ,V 


•  (ru  4,- r2(JCr) r+  ^ fox  ft,-  f:GCf)  9  ' 'fox  $a-riQC\)Trlx , 

(4.15) 


o-ATp+pA+fi„+ £  [Ajpa^iA,  -  (r2i  ft,  -  r:<3cn  p;,'cu)t 

/-I 

•  PfA,- [tJx  ft.-  riGCH  9  C„)]  -  «9,r,  4 -B\PrxyA  * ' 


•  (^.Tix -B\Ptx)+t\^(&,  tu -BIPti)tR~\S‘1t,x-BIPt,)t,1  , 


(4.16) 

O-^G  +  G^  +  O-ix  ft,- rj<5cr>  P’1^  ft,- tzGCPt 

-r,x(rix  ft,-riGcrX>iV(Ttxft,-  n(3cr)rfL .  (417) 
0 - /< $,/*+  A4 q.  +  «J>,ru  - B rpr, ) TA  "‘(^.r, 4  - Ar, ) 

-rf4  (^,ru  -B\Prt)TA  ~  BfpT'Irje ,  (4.18) 

rank  Q  ~  rank  rank  QP=  nc.  (4.19) 

Remark  4.1:  Setting  r,  =  r2  =0,  Dc  =  0,  Ec-0  yields  the  results  of 

[41,1111 

Remark  4.2:  Suppose.  nc=n  so  that  t3*=/„.  Then  the  resulting  full- 
order  nonstrictly  proper  controller  is  characterized  by  four  matrix 
equations  which  generalize  the  standard  LQG  result.  In  this  case  the 
separation  principle  is  no  longer  valid. 

v.  additional  Feedback  Paths 

We  now  introduce  the  feedback  paths  not  shown  in  Fig.  1 .  For  the  static 
problem  replace  (3.5)  by 


QP-GTMT,TGT^!.r.  (4.8a,  b) 


u,(t)=Eey,(n+R,y,(t).  (5.1) 


Proof:  The  result  follows  from  [14,  Theorem  6.2.5). 

Since  QP  is  semisimple  it  has  a  group  inverse  ((J/*)'  «  GTM~'T  and 

r,  A  QP{QP),-GtT  (4.9) 


is  an  oblique  projection. 

Theorem  4.1:  Suppose  (Ae,  Bc,  C„  Dc,  Ec)  6  D*  solves  the  dynamic 
output  feedback  problem.  Then  there  exist  ft  x  n  nonnegative-definite  Q, 


Optimizing  with  respect  to  Kx  yields  the  additional  condition 


0=CiQPBi 


which  implies 


0-r,r,. 


(5-2) 

(5.3) 


This  geometric  condition  holds  when  Aj  is  optimally  chosen.  Although  Aj 


X  G- 
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not  given  explicitly,  it  does  play  a  role  in  the  necessary  conditions  since 
is  replaced  by  A  +  B2KtC2. 

For  the  dynamic  problem  replace  (4.1)  and  (4.3)  by 


Ml )  »r<c*r(f)  +  Bey,(t)  +  *,y2(f), 

(5.4) 

«i(f ) »  Ecy,  (f )  +  K2xM) + A,  y2(t ). 

(35) 

Optimizing  with  respect  to  K,,  K2,  K)  yields 

0  =  C2(QP+Qp+Qfi)B2, 

(5.6a) 

o=Qpb2. 

(5.6b) 

q=c2qP, 

(5.6c) 

which  imply 

0=r2r,. 

(5.7a) 

0=T2Tj, 

(57b) 

0=TjT|. 

(5.7c) 

Note  that  (5.7b)  and  (5.7c)  imply 

0=t2Tjt,. 

(5.8) 

Using  (5.7b),  (5.7c),  (5  »  r,<2,  P  «  Pr}  (see  (4J),  (4. 10)-(4. 18)  become 

Ac=V(A-BlPu'^,-il,P'u'ClAB1KxC2)GT^VB2K2- 

K,  C2Ct, 

(5.9) 

Be-TnW. 

(5.10) 

C,= -f?r>.r.xGr, 

(5.11) 

Of=  -/f,V<J,,QC[(CJQC[)->. 

(5.12) 

E<=  -(BJPBj)'  'B^fA  P  u'. 

(5.13) 

r 

0-AtQ+QA*+  +  2  \A,QAr+(A,-Bu*;,  $ 

irt 

,Tu) 

•  C(A, - B„fi  •' ' <5>,r, * ) n - tJ2 4. P ,v 4,rrL 

+  T .1,  r:iQA,'4,rT2VIi. 

(5.14) 

0  =  A'P+  PA>+  \A'  PA,  +  (A,+  u  CuV 

i  -  I 

•  P(A,  -  rA  p  ;'cu)\  -  r S>]A  S>,t,  A 


-t,lt2i£l,P;,'  t^-G  tK,  CtQ- Q(K,  C2)TG,  (5.16) 

O-sf  £*+ Ai»+r'  <$>;/?  r>.rlx 

- t)Tx  tL  &T* ■>>, -rii-r tK1B2P-P(K1B2)tT,  (5. 17) 

where 

/T)=/f+BJ/r1C2-Grtf)C!,  42  =  ^ + B2Af, C2 + B2tf2r, 

^ca  6  -4g»  +  Bj AT,  C2  -  G  TK2C2,  An  &  An  +  B2K,C2  +  B2K2r. 

VI.  DIRECTIONS  FOR  FURTHER  RESEARCH 

More  general  solutions  can  be  obtained  by  incorporating  singular 
estimation  techniques  (IS)  where  noise-free  measurements  are  repeatedly 
differentiated  to  enlarge  the  class  of  available  outputs. 
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1.  Introduction 


The  singular  LQG  control  problem  has  been  of  considerable  interest  for  almost  two  decades 
([1-15]).  Such  problems  arise  when  some  of  the  measurements  are  noise  free  or  when  some  of  the 
control  signals  are  unweighted.  This  will  be  the  case,  for  example,  if  the  sensor  noise  is  colored  or 
if  actuator  dynamics  are  included.  Augmentation  of  the  plant  dynamics  by  means  of  noise  filters 
or  actuator  dynamics  thus  leads  directly  to  the  singular  problem  formulation. 

Most  of  the  literature  on  the  singular  LQG  problem  is  based  upon  limiting  procedures  in  which 
suitable  weighting  matrices  and  noise  intensities  approach  zero.  These  results  demonstrate  the 
types  of  behavior  which  can  arise  in  the  limiting  solution  including  impulsive  controls  and  singular 
arcs. 

The  available  literature  is  concerned,  of  course,  with  determining  the  optimal  limiting  (i.e., 
singular)  control.  In  practical  applications,  however,  it  is  often  of  interest  to  determine  the  optimal 
controller  within  a  prespecified  class  of  controllers.  In  particular,  we  consider  the  singular  LQG 
problem  in  which  the  controller  is  preconatrained  to  possess  a  fixed  dynamic  feedback  structure. 
One  benefit  of  this  approach  is  that  the  fixed  structure  constraint  eliminates  the  possibility  of 
impulsive  controls  and  other  complex  behavior. 

Preliminary  results  for  the  singular  LQG  problem  were  obtained  in  [15]  using  the  fixed  struc¬ 
ture  approach.  For  generality,  the  problem  considered  in  [15]  permits  the  design  of  fixed-order, 
i.e.,  reduced-order,  dynamic  compensators.  As  in  [16],  the  solution  is  given  by  a  system  of  coupled 
algebraic  Riccati  and  Lyapunov  equations  whose  solutions  (denoted  by  Q,P,Q,P)  are  used  to  ex¬ 
plicitly  characterize  the  optimal  feedback  gains.  The  coupling  is  due  to  a  pair  of  oblique  projections 
(i.e.,  idempotent  matrices)  which  arise  as  a  direct  consequence  of  the  fixed  structure  constraint. 
The  order-reduction  projection  r  defined  by 

r^QP(QP)#, 

where  ( )#  denotes  group  generalized  inverse,  appeared  originally  in  [16],  while  the  static  projection 
v  given  by 

i/  =  QCt{CQCt)~1C, 
is  familiar  from  least  squares  analysis. 

The  results  of  [15]  are  incomplete,  however,  in  that  the  gains  associated  with  certain  feedback 
paths  were  not  given  explicitly.  For  the  corresponding  singular  estimation  problem  ([17])  this  de- 
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feet  was  remedied  in  [18]  where  all  feedback  gains  were  explicitly  characterized.  In  addition,  the 
solution  obtained  in  [18]  was  shown  to  agree  completely  with  results  obtained  using  standard  lim¬ 
iting  methods  when  the  (unconstrained)  optimal  singular  estimator  does  not  possess  differentiators 
([19]).  The  results  of  [18]  thus  provide  an  alternative  approach  to  the  singular  estimation  problem 
considered  in  [20,21,22]  and  the  numerous  references  therein. 

The  contribution  of  the  present  paper  is  thus  to  complete  the  development  of  [15]  by  incorpo¬ 
rating  the  methods  used  in  [18].  Accordingly,  we  derive  a  coupled  system  of  modified  Riccati  and 
Lyapunov  equations  which  explicitly  characterize  the  feedback  gains  of  the  fixed-structure  singular 
LQG  controller.  For  generality  we  consider  partial  or  total  singularity  in  both  the  control  weight¬ 
ing  and  measurement  noise  intensity  matrices,  and  we  allow  the  dynamic  compensator  to  be  of 
arbitrary  dimension  less  than  or  equal  to  the  number  of  plant  states  minus  the  number  of  noise- 
free  measurements.  In  the  special  case  in  which  the  order  of  the  dynamic  compensator  is  equal  to 
the  number  of  plant  states  minus  the  number  of  noise-free  measurements  (i.e.,  the  quasi  full-order 
case),  then  we  show  that  the  optimal  solution  decomposes  (separates)  into  a  reduced-order  observer 
followed  by  state  feedback. 

An  additional  benefit  of  our  approach  is  the  ability  to  impose  an  upper  bound  on  the  number 
of  differentiators  to  be  included  in  the  feedback  controller.  That  is,  while  certain  measurement 
signals  may  be  noise  free  and  hence  differentiable,  it  may  be  undesirable  in  practice  to  implement 
more  than  one  level  of  differentiation  or,  perhaps  any  differentiation  at  all.  Furthermore,  as  in  [18] 
we  demonstrate  connections  with  earlier  results  by  showing  that  the  fixed  structure  solution  agrees 
with  the  standard  limiting  solution  when  the  latter  possesses  the  same  number  of  differentiators  as 
are  included  in  the  prespecified  controller  structure. 

To  illustrate  the  solution  we  consider  a  numerical  example  of  fourth  order  with  two  noise- 
free  measurements  and  one  noisy  measurement.  (Numerical  results  for  the  singular  control  case 
are  immediate  from  duality).  By  solving  the  coupled  systems  of  modified  Riccati  and  Lyapunov 
equations  by  means  of  a  homotopy  algorithm  ([23]),  we  obtain  the  quasi  full-order  solution  (second- 
order  controller)  as  well  as  an  optimal  first-order  controller. 


2 


References 


1.  B.  Friedland,  "Limiting  Form s  of  Optimum  Stochastic  Linear  Regulators,”  Trana.  ASME  J. 
Dyn.  Sya.  Meoa.  Contr.,  Vol.  93,  pp.  134-141,  1971. 

2.  Y.-C.  Ho,  “Linear  Stochastic  Singular  Control  Problems,”  J.  Optim.  Thy.  Appl. ,  Vol.  9,  pp. 
24-31,  1972. 

3.  M.  F.  Hutton,  “Solutions  of  the  Singular  Stochastic  Regulator  Problems,”  Trans.  ASME  J. 
Dyn.  Sya.  Mens.  Contr.,  Vol.  95,  pp.  414-417,  1973. 

4.  H.  G.  Kwatny,  “Minimal  Order  Observers  and  Certain  Singular  Problems  of  Optimal  Estima¬ 
tion  and  Control,”  IEEE  Trana.  Autom.  Contr.,  Vol.  AC- 19,  pp.  274-276,  1974. 

5.  R.  E.  O’Malley,  Jr.,  and  A.  Jameson,  “Singular  Perturbations  and  Singular  Arcs  -  Part  I,” 
IEEE  Trana.  Autom.  Contr.,  Vol.  AC-20,  pp.  218-226,  1975. 

6.  R.  E.  O’Malley,  Jr.,  and  A.  Jameson,  “Singular  Perturbations  and  Singular  Arcs  -  Part  II,” 
IEEE  Trana.  Autom.  Contr.,  Vol.  AC-22,  pp.  328-337,  1977. 

7.  B.  A.  Francis  and  K.  Glover,  “Bounded  Peaking  in  the  Optimal  Linear  Regulator  With  Cheap 
Control,”  IEEE  Trana.  Autom.  Contr.,  Vol.  AC-23,  pp.  608-617,  1978. 

8.  B.  A.  Francis,  “The  Optimal  Linear-Quadratic  Time-  Invariant  Regulator  with  Cheap  Control,” 
IEEE  Trana.  Autom.  Contr.,  Vol.  AC-24,  pp.  616-621,  1979. 

9.  V.  Dragan  and  A-  Halanay,  “Cheap  Control  and  Singularly  Perturbed  Matrix  Riccati  Differ¬ 
ential  Equations,”  Rev.  Roum.  Math.  Purea  et.  Appl.,  Vol.  26,  pp.  21-40,  1981. 

10.  V.  B.  Haas,  “The  Singular  Steady  State  Linear  Regulator,”  SIAM  J.  Contr.  Optim.,  Vol.  20, 
pp.  247-257,  1982. 

11.  J.  O’Reilly,  “Partial  Cheap  Control  of  the  Time-  Invariant  Regulator,”  Int.  J.  Contr.,  Vol.  37, 
pp.  909-927,  1983. 

12.  P.  Sannuti,  “Direct  Singular  Perturbation  Analysis  of  High-Gain  and  Cheap  Control  Problems,” 
Automation,  Vol.  19,  pp.  41-51,  1983. 

13.  M.  L.  J.  Hautus  and  L.  M.  Silverman,  “System  Structure  and  Singular  Control,”  Lin.  Alg. 
Appl.,  Vol.  50,  pp.  369-402,  1983. 

14.  Y.  Halevi  and  Z.  J.  Palmor,  “Extended  Limiting  Forms  of  Optimum  Observers  and  LQG 
Regulators,”  Vol.  43,  pp.  193-212,  1986. 

15.  D.  S.  Bernstein,  “The  Optimal  Projection  for  Static  and  Dynamic  Output  Feedback:  The 
Singular  Case,”  IEEE  Trana.  Autom.  Contr.,  Vol.  AC-32,  pp.  1139-1143,  1987. 

16.  D.  C.  Hyland  and  D.  S.  Bernstein,  “The  Optimal  Projection  Equations  for  Fixed-Order  Dy¬ 
namic  Compensation,”  IEEE  Trana.  Autom.  Contr.,  Vol.  AC-29,  pp.  1C  14-1037,  1984. 

17.  W.  M.  Haddad  and  D.  S.  Bernstein,  “The  Optimal  Projection  Equations  for  Reduced  Order 
State  Estimation:  The  Singular  Measurement  Noise  Case,”  IEEE  Trana.  Autom.  Contr.,  Vol. 
AC-32,  pp.  1135-1139,  1987. 


18.  Y.  Halevi,  “The  Optimal  Reduced  Order  Estimator  for  Systems  with  Singular  Measurement 
Noise,”  IEEE  Trans.  Autom.  Contr .,  Vol.  34,  1989. 

19.  Y.  Halevi,  “Limiting  Forms  of  Optimal  Observers,”  Int.  J.  Contr.,  Vol.  47,  pp.  209-216,  1988. 

20.  A.  E.  Bryson  and  D.  E.  Johansen,  “Linear  Filtering  for  Time  Varying  Systems  Using  Mea¬ 
surements  Containing  Colored  Noise,”  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-10,  pp.  4-10, 
1965. 

21.  J.  M.  Schumacher,  “A  Geometric  Approach  to  the  Singular  Filtering  Problem,”  IEEE  Trans. 
Autom.  Contr.,  AC-30,  pp.  773-776,  1985. 

22.  E.  Soroka  and  U.  Shaked,  “Direct  Solution  to  the  General  Reduced  Order  Stochastic  Observa¬ 
tion  Problem,”  Int.  J.  Contr.,  Vol.  45,  pp.  713-728,  1987. 

23.  S.  Richter,  “A  Homotopy  Algorithm  for  Solving  the  Optimal  Projection  Equations  for  Fixed- 
Order  Dynamic  Compensation:  Existence,  Convergence,  and  Global  Optimality,”  Proc.  Amer. 
Contr.  Conf.,  pp.  1527-1531,  Minneapolis,  MN,  June  1987. 


APPENDIX  F:  Stochastic  Modeling 


D.  S.  Bernstein  and  D.  C.  Hyland,  "The  Optimal  ProjectiaryMaxiraim 
Entropy  Approach  to  Designing  Low-Order,  Robust  Controllers  for 
Flexible  Structures,"  ftrec,  24ttl  IEEE  Oonf,  De£,-Qgnfcr ,  pp.  745-752, 
Fort  Lauderdale,  FL,  December  1985. 

D.  S.  Bernstein,  L.  D.  Davis,  S.  W.  Greeley  and  D.  C.  Hyland, 
"Numerical  Solution  of  the  Optimal  Projecticn/lfaximum  Entropy  Design 
Equations  for  Low-Order,  Robust  Controller  Design,"  Proc.  24th  TERR 
Ctonf.  Dec.  Oorttr. .  pp.  1795-1798,  Fart  Lauderdale,  FL,  December  1985. 

D.  S.  Bernstein  and  D.  C.  Hyland,  "Optimal  Projection  Equations  for 
Reduced-Order  Modelling,  Estimation  and  Control  of  Linear  Systems 
with  Multiplicative  White  Noise,"  -T.  Qnt-im.  Thy.  AdqI.  .  Vol.  58,  pp. 
387-409,  1988. 

D.  S.  Bernstein  and  S.  W.  Greeley,  "Robust  Controller  Synthesis  Using 
the  Maximum  Entropy  Design  Equations,"  TREE  Trans.  Autcm.  Oontr. . 

Vol.  AC-31,  pp.  362-364,  1986. 

D.  S.  Bernstein,  "Robust  Static  and  Dynamic  Output-Feedback 
Stabilization:  Deterministic  and  Stochastic  Perspectives,"  teee 

Vol.  AC-32,  pp.  1076-1084,  1987. 


>uHJM*na«  o>  Xth  Jon Hww 
gn  DtcMen  aid  Centra) 
p.  uudwM«,  FL  •  - - 


TA3  - 10:30 


THE  OPTIMAL  PROJECTION/MAXIMUM  ENTROPY  APPROACH 
TO  DESIGNING  LOW-ORDER,  ROBUST  CONTROLLERS 
FOR  FLEXIBLE  STRUCTURES 


Dennis  S.  Bernstein  and  David  C.  Hyland 


Harris  Corporation 

Government  Aerospace  Systems  Division 
Controls  Analysis  and  Synthesis  Group 
Melbourne,  Florida  32902 


Abstract.  The  Optimal  Projection/Maximum  Entropy 
approach  to  designing  low-order  controllers  for 
high -order  systems  with  parameter  uncertainties 
Is  reviewed. 

The  philosophy  of  representing  uncertain 
parameters  by  means  of  Stratonovlch 
multiplicative  white  noise  Is  motivated  by  means 
of  the  Maximum  Entropy  Principle  of  Jaynes  and 
statistical  analysis  of  modal  systems.  The  main 
result,  the  optimal  projection  equations  for 
fixed-order  dynamic  compensation  In  the  presence 
of  state-,  control-  and  measurement-dependent 
noise,  represents  a  fundamental  generalization  of 
classical  LOG  theory. 

1.  Overview 

Optimal  Projection/Maximum  Entropy  Stochastic 
Modelling  and  Reduced-Order  Oeslgn  Synthesis 
Is  a  rigorous  new  approach  to  designing  robust, 
Implementable  feedback  controllers.  Inspired 
by  Statistical  Energy  Analysis  Cl],  a  branch  of 
dynamic  modal  analysis  developed  for  analyzing 
acoustic  vibrations.  Its  present  stage  of 
development  [2-22],  embodies  a  mathematically 
rigorous,  fundamental  generalization  of  classical 
steady -state  Kalman  filter  and  11  near-quadratic  - 
Gaussian  (LQG)  optimal  control  theory.  Although 
LQG  theory  Is  an  effective  tool  for  optimally 
quantifying  performance/sensor -resolution  and 
performance/actuation -level  tradeoffs.  It  suffers 
from  two  fundamental  defects  which' severely  limit 
Its  usefulness  In  practice. 

1.  Whereas  the  dimension  of  an  LQG 
controller  must  equal  that  of  the  controlled 
plant,  optimal  projection  design  characterizes 
the  quadratlcally  optimal  controller  of  fixed 
dimension  less  than  that  of  the  plant  in 
accordance  with  Implementation  constraints  (e.g., 
reliability,  complexity  or  real-time  computing 
capability). 

f  2.  Whereas  LQG  presumes  exact  knowledge  of 
each  and  every  parameter  appearing  In  the  state- 
space  plant  description,  maximum  entropy 
modelling  provides  a  stochastic  plant  model  which 
admits  Ignorance  with  regard  to  parameter  values 
In  accordance  with  unavoidable  plant  modelling 
errors. 


with  regard  to  the  latter  Item,  It  should  be 
stressed  that  one  of  the  major  problems  In 
designing  high-performance  control  systems  Is 
that  of  robustness,  l.e.,  the  ability  of  the 
controller  to  tolerate  errors  In  the  plant  model 
upon  which  Its  design  Is  predicated.  Maximum 
entropy  modelling  directly  addresses  this  problem 
by  Incorporating  Into  the  dynamic  model  a  repre¬ 
sentation  of  Ignorance  (l.e.,  uncertainty) 
regarding  physical  parameters.  Roughly  speaking, 
the  Idea  behind  the  approach  Is  to  use  a  probabi¬ 
listic  representation  of  each  Imperfectly  known 
plant  parameter  so  that  the  quadratlcally  optimal 
control  system  designed  under  this  probabilistic 
model  1 s  automatically  desensitized  to  actual 
parameter  variations  when  the  control  system 
Is  Implemented.  The  overall  control -desl gn 
procedure  thus  avoids  laborious  trial  and  error 
post-design  “tweaking." 

2.  Motivation 

The  inherent  time-  and  frequency-domain  duality 
In  representing  linear  dynamic  systems  (l.e., 
state  space  versus  transfer  functions)  provides 
control -system  designers  with  complementary 
methodologies  for  assessing  tradeoffs  between 
performance  objectives  and  the  design  constraints 
of  sensor  resolution,  actuation  levels,  plant 
modelling  accuracy  and  controller  complexity.  In 
spite  of  the  ability  of  LQG  to  optimally  quantify 
performance/sensor-resolution  and  performance/ 
actuation-level  tradeoffs  in  a  state-space 
setting,  Its  enormous  sensitivity  to  plant 
modelling  errors  has  forced  practitioners  to  seek 
generalizations  of  classical  frequency  domain 
methods.  In  numerous  practical  situations, 
however.  Input/output  techniques  possess  funda¬ 
mental  limitations.  For  example,  representing 
modelling  uncertainty  in  a  frequency -domain  plant 
model  G(s)  by  means  of 

G(s)  +  aG(s), 

where  AG  remains  In  a  normed  neighborhood  of  G, 

Is  essentially  a  black-box  (nonparametrlc) 
approach:  By  falling  to  exploit  physical  laws 
(such  as  conservation  of  energy),  systems 
represented  by  G  +  AG  may  actually  be  physically 
Impossible,  resulting  In  unwarranted  design 
conservatism  at  the  expense  of  system 
performance.  Hence,  when  some  knowledge  of 
Internal  mechanisms  Is  available  (l.e.,  the 
“grey-box"  situation),  state-space  representa¬ 
tions  may  provide  greater  modelling  fidelity- 
These  observations  are  motivated  by  the  problem 
of  controlling  vibration  In  flexible  structures 
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where  Internal  energy  dissipation  precludes 
right-half -plane  poles  and  where  nigh-order 
finite -element  models  have  highly  structured 
dynamics  but  possess  numerous  uncertain 
parameters.  More  specifically,  frequency 
uncertainties  for  higher  order  modes  are  much 
larger  In  magnitude  than  damping  uncertainties. 
Hence,  the  Inability  to  differentiate  between 
these  physical  parameters  In  an  Input-output 
representation  leads  to  severe  performance 
consequences. 

The  optimal  projection/maximum  entropy  approach 
generalizes  LQG  theory  In  two  fundamental 
respects:  design  of  reduced-order  controllers 
plus  accommodation  of  a  priori  parameter 
uncertainties.  For  clarity,  we  discuss  these 
generalizations  separately  following  the  left 
branch  of  Fig.  1.  Optimal  projection  design  Is 
discussed  In  Section  3,  followed  by  maximum 
entropy  modelling  In  Sections  4,  5,  and  6. 


OPTIMAL  PROJECTION/MAXIMUM  ENTROPY 
APPROACH  TO 

LOW-ORDER,  ROBUST  CONTROLLER  DESIGN 


Fig.  l 


3.  Review  of  the  Optimal  Projection  Approach 

Most  research  Into  the  design  of  reduced-order 
controllers  Involves  one  of  two  sequential 
procedures:  model  reduction  followed  by 
controller  design,  or  controller  design  followed 
by  controller  reduction.  The  optimal  projection 
equations  represent  a  radical  departure  from  both 
of  these  approaches  by  directly  characterizing 
the  quadratlcally  optimal  reduced-order  control¬ 
ler  for  a  high-order  model.  Assuming  a  purely 
dynamic  linear  structure  for  the  desired 
compensator,  whose  order  Is  determined  by 
Implementation  constraints,  a  parameter 
optimization  approach  Is  taken.  There  Is,  of 
course,  nothing  novel  about  this  approach  per  se 
and  It  has  been  widely  studied  In  the  control 
literature  (see.  -iferences  listed  In  [18]).  This 
approach,  however,  fell  Into  disrepute  because  of 
the  extreme  complexity  of  the  grossly  unwieldy 
first-order  necessary  conditions  which  afforded 
little  Insight  and  engendered  brute -force 
gradient  search  techniques.  The  crucial 
discovery  occurred  [7]  where  It  was  revealed  that 
the  necessary  conditions  for  the  dynamlc- 
comoensatlon  problem  give  rise  to  the  definition 


of  an  optimal  projection  as  a  rigorous, 
unassailable  consequence  of  quadratic  optimality 
without  recourse  to  ad  hoc  methods.  Exploitation 
of  this  projection  leads  to  Immense  simplifi¬ 
cation  of  the  "primitive"  form  of  the  necessary 
conditions  which  now  provide  a  transparent 
generalization  of  the  pair  of  separated  Rlccatl 
equations  of  standard  LQG  theory.  In  particular, 
the  optimal  projection  equations  comprise  a 
system  of  four  matrix  equations  coupled  by  an 
oblique  projection  which  determines  the  optimal 
controller  gains.  The  system  of  matrix  equations 
Includes  a  pair  of  modified  Rlccatl  equations 
which  are  analogous  to  the  standard  Rlccatl 
equations,  along  with  a  pair  of  modified  Lyapunov 
equations  which  arise  separately  In  the  model 
reduction  problem  [19].  The  coupling  by  means  of 
the  projection  reveals  the  inherent 
Inseparability  of  these  operations  In  the 
reduced -order  case  since  optimality 
considerations  demand  that.  In  a  very  precise 
sense,  "reduction"  and  “control  design"  be 
performed  simultaneously.  Hence  the  full -order 
model  Is  retained  throughout  the  control  design 
process  and  there  is  no  need  to  truncate  the 
plant  model . 

4.  Maximum  Entropy  Modelling 

Although  optimal  projection  design  deals  directly 
and  rigorously  with  the  question  of  system 
dimension  by  trading  order  off  against  perfor¬ 
mance,  It  Is,  nevertheless,  predicated  upon  the 
availability  of  a  completely  accurate  plant  and 
disturbance  model.  Maximum  entropy  modelling, 
however,  addresses  the  robustness  problem  by 
directly  Including  parameter  uncertainties  In 
the  plant  and  disturbance  models  so  that  optimal 
projection  design  plus  maximum  entropy  modelling 
automatically  yields  control  designs  that  trade 
performance  off  against  modelling  uncertainties. 
In  order  to  review  the  maximum  entropy  approach 
it  Is  Important  to  discuss  the  class  of  problems 
that  motivated  this  work,  namely,  control  of 
flexible  structures.  A  finite -element  model  of 
a  large  flexible  structure  Is,  generally,  an 
extremely  high -order  system.  For  example,  a 
version  of  the  widely  studied  Draper  Model  #2 
Includes  3  rigid  body  modes,  147  elastic  modes 
and  6  disturbance  states,  l.e.,  a  total  of  306 
states,  along  with  9  sensors  and  9  actuators. 
Besides  the  high  order  of  these  systems,  finite 
element  modelling  Is  known  to  have  poor  accuracy, 
particularly  for  the  high -order  modes. 

Reasonable  and  not  overly  conservative  uncer¬ 
tainty  estimates  predict  30-50  percent  error  In 
modal  frequencies  after  the  first  10  modes,  with 
the  situation  considerably  more  complex  (and 
pessimistic)  for  damping  estimates. 

Maximum  entropy  modelling  Is  a  form  of  stochastic 
modelling.  Although  external  disturbances  are 
traditionally  modelled  as  random  processes,  the 
use  of  stochastic  theory  to  model  plant  parameter 
uncertainty  has  seen  relatively  limited  applica¬ 
tion.  To  dispel  all  objections  to  a  stochastic 
parameter -uncertainty  model,  we  Invoke  the  modern 
Information -theoretic  Interpretation  of  probabil¬ 
ity  theory.  Rather  than  regard  the  probability 
of  an  event  as  an  objective  quantity  such  as  ' 
the  limiting  frequency  of  outcomes  of  lumerous 
repetitions  (as,  e.g.,  the  number  of  heads  In 
1,000  coin  tosses),  we  adopt  the  view  that  the 
probabl 1 1 ty  of  an  event  1 s  a  subjective  quantl ty 
which  reflects  the  observer's  certainty  as  to 
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uhether  a  particular  event  will  or  will  not 
occur.  11)1  s  quantity  Is  nothing  more  than  a 
measure  of  the  Information  (Including,  e.g. , 

,11  theoretical  analysis  and  empirical  data) 
available  to  the  observer.  In  this  sense  the 
validity  of  a  stochastic  model  of  a  flexible 
structure,  for  example,  does  not  rely  upon  the 
existence  of  a  fleet  of  such  objects  (substitute 
•ensemble"  for  "fleet*  In  the  classical  termi¬ 
nology)  but  rather  resides  In  the  Interpretation 
that  It  expresses  the  engineer's  certainty  or 
uncertainty  regarding  the  values  of  physical 
parameters  such  as  stiffnesses  of  structural 
components.  This  view  of  probability  theory  has 
Its  roots  In  Shannon's  Information  theory  but  was 
first  articulated  unambiguously  by  Jaynes  [23-26]. 

The  preeminent  problem  In  modelling  the  real 
world  Is  thus  the  following:  Given  limited 
(Incomplete)  a  priori  data,  how  does  one 
construct  a  well-defined  (complete)  probability 
model  which  Is  consistent  with  the  available  data 
but  which  avoids  Inventing  data  which  does  not 
exist?  To  this  end  we  Invoke  Jaynes'  Maximum 
Entropy  Principle:  First,  define  a  measure  of 
Ignorance  In  terms  of  the  Information-theoretic 
entropy,  and  then  determine  the  probability 
distribution  which  maximizes  this  measure  subject 
to  agreement  with  the  available  data.  The 
reasoning  behind  this  principle  Is  that  the 
probability  distribution  which  maximizes  the 
a  priori  Ignorance  must  be  the  least  presumptive 
(l.e. ,  least  likely  to  Invent  data)  on  the 
average  since  the  corresponding  amount  of 
a  posteriori  learned  Information  (should  all 
uncertainty  suddenly  disappear)  would  necessarily 
be  maximized.  If,  for  some  probability  distribu¬ 
tion,  the  a  priori  Ignorance  and  hence  the 
a  posteriori  learning  were  less  than  their  poten¬ 
tially  maximum  value,  then  this  distribution  must 
be  based  upon  Invented  and  hence  generally  Incor¬ 
rect  data.  The  Maximum  Entropy  Principle  Is 
clearly  desirable  for  control -system  design  where 
the  Introduction  of  false  data  Is  to  be  assidu¬ 
ously  avoided. 

5.  Minimum-Information  Modelling  of 
Parameter  (Mcertaintles 


For  dynamical -system  modelling  It  was  first  shown 
by  Hyland  [2]  that  for  structural  systems  the 
minimum  Information  linear  stochastic  dynamic 
model  Induced  by  the  Maximum  Entropy  Principle  of 
Jaynes  Is  a  Stratonovlch  multiplicative  white 
noise  model.  In  the  present  paper  we  adopt  this 
model  and  explore  Its  ramifications  for  general 
systems.  The  basic  model  Is  given  by 

x'(t)  ■  (A  +  j^VjUlXjJxtt)  +w(t),  (5.1) 

where  )T(t)«  ,  A,  A,j€jlnxn,  w(t)  Is  zero- 

mean  Gaussian  white  disturbance  noise  with 
non -negative -definite  Intensity  V,  and  v^(t) 

are  zero-mean,  unit-intensity  Gaussian  white 
noise  processes  which  are  mutually  uncorrelated 
and  uncorrelated  with  W(t).  The  multiplicative 
white  noise  model  (5.1)  can  be  regarded  as  a 
parameter  uncertainty  model  where  each  v^t) 

corresponds  to  a  single  uncertain  parameter  whose 
pattern  and  magnitude  are  given  by  A^/l  |A^  1 1 

and  1 1 Aj 1 1 ,  respectively. 


To  see  why  (5.1)  Is  a  minimum  Information  model 
of  parameter  uncertainty,  note  that  when  the 
pattern  Aj/I |Aj  1 1  of  an  uncertain  parameter 

Is  known,  all  available  data  (theoretical  and 
empirical)  can  be  used  to  determine  a  suitable 
value  for  the  magnitude  IIA^II  to  reflect  the 

corresponding  level  of  uncertainty.  Clearly,  the 
collection  of  magnitudes  constitutes  the  minimum 
data  set  needed  to  render  (5.1)  well  defined. 

For  the  harmonic  oscillator  with  uncertain 
natural  frequency,  the  uncertainty  magnitude  Is 
given  by  the  reciprocal  of  the  decorrelation  time 
(Fig.  2).  Note  that  the  uncertainty  represen¬ 
tation  (5.1)  Is  a  minimum  Information  model  In 
the  sense  that  It  eschews  detailed  descriptions 
of  joint  probability  statistics  of  unknown 
parameters. 


MINIMUM-INFORMATION  MODELLING 

DECORRELATION  TIME 

••  Sim 

PM  •  PMIAdun  DISTMUTKM  or  .  REFLECTING  UNCERTAIN  _l> 


T  •  -DAMPING'  THU  CONSTANT 
TWA  DYNAMIC  UNCERTAINTY  MEASURE 


2 


To  eliminate  the  white  noise  formalism,  the  model 
(5.1)  Is  usually  rlgorlzed  by  the  Ito  differen¬ 
tial  equation 

p 

di"t  «  (Xdt  +  E  dVjtA^)x"t  +  dwt,  (5.2) 

where  dvit  and  dwt  are  Brownian  motions, 
l.e.,  Wiener  processes.  Although  such  models 
were  studied  extensively  for  control  design,  this 
approach  fell  Into  disrepute  with  the  publication 
of  [27,  28]  where  It  was  shown  for  discrete-time 
systems  that  sufficiently  high  uncertainty  levels 
(i.e.,  magnitudes  llXjll  above  a  "threshold") 

lead  to  the  nonexistence  of  a  steady-state 
solution.  Although  It  was  purported  that  this 
■phenomenon"  was  an  "obvious*  consequence  of 
high  uncertainty  levels,  these  conclusions 
failed  to  take  Into  account  (possibly  because  of 
the  discrete-time  setting)  the  subtle 
relationship  between  the  ordinary  differential 
equation  (5.1)  and  the  stochastic  differential 
equation  (5.2).  Indeed,  It  was  shown  In  [29] 
that  if  a  stochastic  differential  equation  Is 
regarded  as  the  limit  of  a  sequence  of 
approximating  ordinary  differential  equations, 
then  (5.2)  Is  not  the  correct  version  of  (5.1). 
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Instead,  the  ordinary  differential  equation  (5.1) 
with  multiplicative  white  noise  corresponds  to 
the  corrected  Ito  differential  equation 

p 

d?t  *  (Xjdt  +  £  dv<t^l  +  (®*3) 


to  address  the  following  question:  How  do  the 
solutions  of  the  stochastic  Lyapunov  equations 
(5.7)  and  (5.8)  differ  from  each  other  and  from 
the  "deterministic''  Lyapunov  equation 

ft(t)  •  MT(t)  Q(t )V  (5.9) 


where 


particularly  In  the  presence  of  high  uncertainty 
levels?  The  answer  to  this  question  of  course 
depends  upon  the  stochastic  modification  terms 
(5.4)  which  for  the  naive  mode)  are  given  by 


which  differs  from  the  "naive"  equation  (5.2) 
by  a  systematic  drift  term.  The  form  of  (5.3) 
was  corroborated  completely  Independently  by 
Stratonovlch  [30],  whose  results  actually 
appeared  In  the  Russian  literature  prior  to 
1965.  His  approach  Is  based  upon  an  alternative 
definition  of  the  stochastic  Integral  which 
differs  from  the  Ito  definition  by  a  mathematical 
technicality. 

In  spite  of  the  glaring  technicality  of  the 
Stratonovlch  correction,  almost  all  research 
on  the  estimation  and  control  of  such  systems 
failed  to  perceive  Its  physical  significance. 
Specifically,  the  Stratonovlch  correction 
neutralizes  the  "threshold  uncertainty 
principle":  For  systems  which  are  Inherently 
stable  under  particular  parameter  variations 
(e.g.,  structures  with  uncertain  stiffness 
matrices),  the  Stratonovlch  formulation  correctly 
predicts  unconditional  second-moment  stability  In 
contrast  to  the  Ito  formulation  within  which  a 
stringent  uncertainty  threshold  Is  encountered. 

We  shall  now  proceed  to  demonstrate  this  fact  by 
means  of  a  compelling  example  relevant  to  the 
modeling  and  control  of  flexible  structures.  In 
particular,  and  hyperbolic  systems.  In  general. 

First,  suppose  that  zero-point  deviations  of  3T(t) 
are  of  Interest  and  are  evaluated  according  to 

J  «  lim  Ex(t)TRx(t)  *  lim  tr  Q(t)R,  (5.5) 
t-»«®  ”  t->«® 


M.ft(t)]  *  EjUftttfT  (5.10) 

-1  1-1  1  1 


and  for  the  corrected  model  by 


Ms[0(t)>  £  EjXft(t)  +  ^(t)A^T+^(t)A{].  (5.11) 
1  «1 

Consider  a  system  consisting  of  a  pair  of  lightly 


damped  modes  so  that 

0 
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where  m 

“  £1  “1  . 

and  to  represent 

frequency  uncertainties  let 
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where  R  e  and  the  second  moment  of  the 
state  1 s  ~ 


Q(t)  *  |[x(t)x(t)T].  (5.6) 


The  obvious  fact  cannot  be  overemphasized  that 
the  primary  state  statistic  of  design  interest  In 
linear -quadratic  optimization  Is  the  state 
covariance  (5.6).  From  Ito  calculus  It  follows 
that  <J(t)  Is  given  for  the  naive  model  (5.2)  by 

$(t)  -  AQ(t)  +  <J(t)XT  +  £  A.Q(t)Al  +  V  (5.7) 

1-1  1  1 

and  for  the  corrected  model  (5.3)  by 


$(t)  -  /CsQ(t)  +  Q(t)^  +  £  AjQjtjA}  +  V.  (5.8) 

Each  of  these  "stochastic"  Lyapunov  differential 
equations,  which  govern  the  evolution  of  the 
second  moment,  should  be  regarded  as  n(n+l)/2 
ordinary  differential  equations.  Hence  we  wish 


*2  '  y2 


0 

0 

0 

0 


0  0  o' 

0  0  0 

0  0-1 
0  1  0 


where  for  simplicity  we  have  Ignored  the  effects 
of  frequency  uncertainties  on  the  effective  decay 
rate  rjj.  The  magnitudes  of  the  uncertainties 

are  scaled  by  means  of  Y^  and  Yg.  For  this 
example  the  Ito  stochastic  modification 
MjCQ(t)]  has  the  form 


-vftjltl 

0 

0 


0 

0 


0 

0 

-iV*' 


0 

0 
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Although  the  off-diagonal  terns  have  a 
stabilizing  effect.  It  Is  clear  that  the  diagonal 
el  events  destabilize  the  state  variances.  Hence, 
It  Is  not  surprising  that  for  sufficiently  high 
uncertainty  levels,  l.e.,  Yj»0,  the  Ito  model 

Is  second-moment  unstable.  These  observations 
are  completely  In  accordance  with  the  threshold 
uncertainty  principle.  The  Stratonovlch 
corrected  stochastic  modification  M$r$(t)], 
however,  has  the  form 


-*&*<*> 

>K'Vt) 


-^(ti 


which  also  has  stabilizing  off-diagonal  elements 
but  has  fundamentally  different  diagonal 
elements:  Rather  than  destabilizing  the  state 
variances,  the  diagonal  elements  of  the  corrected 
stochastic  modification  are  equilibrating.  This 
effect  is  even  more  striking  when  and  Ms 
are  transformed  Into  the  basis  wltJi  respect  to 
which 


A 


0 

JV’l 

0 

0 


0 

0 

-Jw2-ti2 

0 


where  higher  order  terms  In  n  have  been  ignored. 
In  this  basis,  the  diagonal  terms  of  Mj[Q(t)] 

are  destabilizing  whereas  the  diagonal  terms  of 
Ms[$(t)]  exactly  vanish. 


The  negative  coefficients  In  the  off-diagonal 
terms  imply  progressive  decorrelation  between 
pairs  of  dynamical  states.  Yhls  Informational  or 
statistical  damping  phenomenon  Is  a  direct  result 
of  parameter  uncertainties  captured  by  the 
multiplicative  white  noise  model.  Ifie 
Stratonovlch  correction,  moreover.  Is  crucial: 

By  neutralizing  the  threshold  uncertainty 
principle.  It  permits  the  consideration  of 
iong-term  effects  for  arbitrary  uncertainty 
levels. 


As  an  example  of  the  ramifications  of  these 
observations,  assume  (as  Is  usually  the  case  in 
practice)  that  uncertainties  In  modal  frequency 
obtained  from  finite-element  analysis  of  a 
flexible  structure  Increase  with  mode  number. 

From  the  form  of  MgCOft)]  It  Is  easy  to  deduce 
that  the  steady -state  covariance 

11m  ttt) 

t-**o 

satisfying 

0  ♦.£  ♦  v  (5.12) 

*  *  1-1  1  1 


becomes  increasingly  diagonally  dominant  with 
Increasing  frequency  and  thus  assumes  the 
qualitative  form  given  in  Fig.  3.  The  benefits 
of  this  sparse  form  are  Important:  The  computa¬ 
tional  effort  required  to  determine  the  steady- 
state  covariance  (and  thus  to  design  a  closed- 
loop  controller,  for  example)  is  directly  propor¬ 
tional  to  the  amount  of  information  reposed  In 
the  model  or,  equivalently,  Inversely  propor¬ 
tional  to  the  level  of  modelled  parameter 
uncertainty.  This  casts  new  light  on  the 
computational  design  burden  vis-a-vis  the 
modelling  question:  The  computational  burden 
depends  only  upon  the  Information  actually 
available.  A  simple  control -design  exercise 
Involving  full -state  feedback  Illustrates  this 
point.  The  gains  for  the  higher  order  modes  of 
the  beam  In  Fig.  4,  whose  frequency  uncertain¬ 
ties  Increase  linearly  with  frequency,  were 
obtained  with  modest  computational  effort  In 
spite  of  ft  *  100  (see  Fig.  5).  Another  Important 
ramification  of  the  qualitative  form  of  $  Is  the 
automatic  generation  of  a  h1gh-/low-authority 
control  law.  Note  that  for  the  higher  order  and 
hence  highly  uncertain  modes  the  control  gains 
Indicate  an  Inherently  stable,  low-performance 
rate -feedback  control  law,  whereas  for  the 
lowest-order  modes  the  control  law  Is  high 
authority,  i.e..  "LQ“  In  character. 

EFFECT  OF  FREQUENCY  UNCERTAINTIES  ON 
THE  QUALITATIVE  STRUCTURE  OF  THE 
STEADY-STATE  COVARIANCE  O  =  lim  E[x(t)x(l)T] 

1-“ 


FULL-STATE  FEEDBACK  CONTROL  SCHEME 


mii  wmm  lua  anil  mm  Ktutna 


Fig.  4 
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STOCHASTIC  BEAM  PROBLEM— GAIN  MAGNITUDES 


4  M4W  MHCt  MWIt  W  ItAIHUM  (CTMPY 


Fig.  5 


6.  Optimal  Projection  Design  with 

Stfatonovlcn  Multiplicative  White  Noise 

To  state  the  Reduced-Order  Dynamic  Compensation 
Problem,  we  require  the  following  notation.  Let 

x  t  Rn,  y<RZ.  ucRm,  A,  A1 . ApCR"*", 

B,  B-,  ,...,Bp«  Rnxm,  C,  Clt...,Cp  c  Ri*n,  nc<n, 

n  n  xn  n  xz  mxn 

x  «  R  C,  A  €  R  c  c,  B  e  R  c  ,  C  <  R  c, 

v  M  L  *  C  *  v  * 

R^r"*",  R^O.  R2£Rra,  R2>0,  R12€RnWn- 


Furthermore,  let  Vp...,vp  be  unit-intensity, 
zero -mean  and  mutually  uncorrelated  white  noise 
processes  and  let  w-j  e  Rn  and  w2  e  R^  be 

zero-mean  white  noise  processes  with  Intensities 
V^aO  and  V^O,  respectively,  and  cross¬ 
intensity  Assume  that  v^.Wj 

and  x(0)  are  uncorrelated.  He  require  the 
technical  assumption  that,  for  each  1,  B1  #0 

Implies  C|  •  0,  l.e.,  the  control  -  and 

measurement -dependent  noises  are  uncorrelated. 


Optimal  Reduced -Order  Dynamic -Compensation 
m>b1em.  Given  the  controlled  system 


•  (A+Ev.A.lx  +  (B+  £  V.B,  )u  ♦  w..  (6.1) 

1-1  11  1-1  1  1  1 


y 


(C+y  v  c  )x  +  w 
i-i  1  1  2 


(6.2) 


design  an  ncth -order  dynamic  compensator 


x.  *  Ax.  +  B„y,  (6.3) 

C  v  c  c 

u  «  C  x  (6.4) 

c  c 

which  minimizes  the  performance  criterion 


J ( A  ,B  ,C  )  •  lim  E[xTR  x+2xTR  u+uTR  u].  (6.5) 

c  c  c  t_“  1  12  2 

To  guarantee  that  J  Is  finite  and  Independent  of 
Initial  conditions,  we  restrict  (Ac,Bc,Cc) 

to  the  (open)  set  of  second-moment-stabilizing 
triples 


S  *  {(Ac,Bc,Cc)  :  Xstfs  +  £  Is  stable 

and  (A.,B.,C_)  Is  controllable  and  observable  > , 
c  c  c  I 

where  9  and  •  denote . Kronecker  sum  and  product  and 


A 

B  C  1 

A1 

B1Cc 

V 

$ 

SC| 

•  *1  * 

B  C. 

A 

BcCi 

0 

c  s 

c  J 

6  cs‘ c 

Call  a  square  matrix  positive  semi  simple  If  it 
has  positive  eigenvalues  and  a  diagonal  Jordan 
canonical  form,  l.e..  If  It  Is  similar  to  a 
positive-diagonal  (or,  equivalently,  a 
positive -definite)  matrix.  The  following  lemma 
is  proved  In  [19]. 

Lenina  6.1 .  If  nxn  0,  P  are  non-negative 
definite  and  rank  QP  »  n(  then  there  exist 

n£xn  G.Tand  ncxnc  positl- --semi  simple  M 

such  that 

§£  -  slur,  (6.6) 

rGT  -  In{;.  (6.7) 


For  convenience  In  stating  the  main  result,  we 
shall  refer  to  G,  M  and  r  satisfying  (6.6)  and 

(6.7)  as  a  projective  factorization  of  ffi. 

For  convenience  In  stating  the  optimality 
conditions,  define  the  following  notation  for 

Q,  P,  6,  £  «Rnxn: 

R2s*  *2  *  i£bJ(P+^)B1  . 


V2s  *  v2  ♦ 
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2,  •  ocj  *  v,* .  t?yix«>cf. 
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*q,  *  *.  -  VilV 

*p.  *  *.  -  v;lv 

t  *  GTr,  tx-  in-  T. 
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■Vzl- 

(6.9) 

-4e/- 
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0  -  A^-KJA^+V,  +  ^  CA1Qa]‘+(  Al  -8^2^)^ 
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ABSTRACT 

This  paper  summarizes  some  recent  results 
obtained  using  the  optimal  pro jection/aaxiaum  entropy 
control-design  equations.  The  aain  results  include: 
low-order  controllers  for  CSDL  Model  #2;  robust 
controllers  for  the  SCOLE  and  VCOSS  A  aodels  with 
modal-frequency  uncertainties;  and  Doyle's  example. 

1.  Introduction 

The  optiaal  project  ion/  maxima  entropy  design 
equations  are  discussed  in  1 1 J— £ 5 j  and  a  complete, 
self-contained  derivation  appears  in  [ 51 •  In  brief, 
these  equations  generalise  classical  LQG  theory  in  two 
distinct  ways.  First,  the  controller  is  constrained 
to  have  a  fixed,  reduced  order  and  the  resulting 
necessary  conditions  involve  an  oblique  projection 
[1].  And,  second,  multiplicative  white  noise  is 
introduced  into  the  plant  to  capture  the  statistical 
effects  of  paraaeter  uncertainty.  The  resulting 
dynaaical  equation  is  interpreted  according  to 
syaaetric  Stratonovich  stochastic  integration  and, 
using  the  theory  of  stochastic  approximation,  has  been 
aotivatcd  by  the  maxima  entropy  principle  of  Jaynes. 


that,  for  lightly  damped  structures,  significant 
aodal-frequency  uncertainty  corresponds  to  pronounced 
spectral-resonance  shifting.  Frequency-domain  bounds 
for  such  perturbations  are  consequently  large  and 
hence  may  result  in  conservative  performance 
estimates. 

4.  VCOSS  A 

The  VCOSS  A  model  [11]  is  a  version  of  CSDL  stodel 
#2  involving  9  colocated  sensor/actuator  pairs  plus  2 
line-of-sight  sensors.  For  the  28-state  (14-aode) 
model  and  corresponding  28-state  LQG  design  obtained 
in  [11],  the  sensitivity  to  modal-frequency 
perturbation  is  shown  in  Figure  4.  Note  that 
instability  results  from  3Z  modal-frequency 
perturbations  of  one  of  the  modelled  poles.  For  the 
maximum  entropy  design  (Figure  5)  the  robustness  is 
considerably  improved  with  approximately  20Z 
performance  trade.  Of  course,  there  are  a  continuum 
of  intermediate  designs  that  could  be  obtained  for 
desired  performance/robustness  tradeoffs.  Tbe  closed- 
loop  stability  margins  for  the  full  142-aode 
evaluation  model  are  shown  in  Figure  6. 

5.  Pgylt'f  E*WPlt 


2.  CSDL  #2 

The  optiaal  projection  (OP)  reduced-order  design 
equations  were  solved  for  the  20-state  version  of  CSDL 
Model  #2  treated  in  [6,7].  For  various  control- 
authority  levels,  OP  designs  were  obtained  for  orders 

n£  “  10,  6  and  4.  Figure  1  summarizes  tbe  results 
obtained  in  [6,7].  Note  that  for  compensator  order  n£ 

•  4,  the  allowable  control  bandwidth  is  severely 
reatricted.  The  OP  designs,  however,  all  lie  within 
the  shaded  band  close  to  the  LQG  performance  over  a 
considerably  expanded  range  of  control  bandwidths. 
Relative  to  LQC,  the  performance  of  the  OP  designs  is 
given  in  Figure  2.  Details  of  the  numerical  algorithm 
used  to  obtain  these  results  are  given  in  [8]. 

3.  8CQUP 


Aa  a  final  application  of  the  ME  design 
equations,  we  consider  tbe  problem  used  in  [12]  to 
demonstrate  the  lack  of  robustness  of  LQG  designs.  As 
shown  in  [12]  (see  [4]  for  notation),  LQG  regulators 
for  the  example 


Tbe  SCOLE  configuration  is  discussed  at  length  in 
[9,10].  The  model  utilised  in  [9]  involves  16  states, 
12  actuators  and  17  sensors.  The  LQG  design  reveals 
instability  resulting  from  52  modal-frequency 
perturbations.  Using  the  maximum  entropy  (ME)  design 
equations,  a  pair  of  controllers  were  obtained  in  the 
presence  of  stochastically  modelled  nodal-frequency 
up-ertaintiee.  Tbe  first  design  exhibits  near-LQG 
performance  with  602  increese  in  robustness,  while  the 
second  design  is  considerably  more  robust  (behaving 
more  like  tbe  open-loop  structure)  with  nominal 
performance  within  62  of  LQG.  These  designs  (Fig.  3) 
illustrate  the  performance/robustness  tradeoff 
capabilities  of  the  ME  method.  It  should  be  noted 


have  arbitrarily  small  stability  margin  with  regard  to 
variations  b  +  4b  when  c  and  p  are  sufficiently  large 
and  b  -  1.  Setting  <7  -  P  -  60,  it  follows  that  tbe 
LQC  regulator  is  only  stable  for  .93  <  beab  <  1.01. 
Uncertainty  in  b  can  be  modelled  by  setting  p  •  1, 

Aj  ”  0,  "  [0  6j]*  and  Cj  »  0.  Solving  the  ME 

design  equations  with  bj  -  .05,  .10,  .15  and  .20 

yields  a  series  of  increasingly  robust  controller 
designs  with  respect  to  both  positive  and  negative 
variations  db  (see  Figures  7  and  8).  For  more 
details,  see  [13]. 
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Abstract.  The  optimal  projection  equations  for  quadratically  optimal  reduced- 
order  modelling,  estimation  and  control  are  generalized  to  include  the  effects 
of  state-,  control-  and  measurement-dependent  noise. 

Key  Words.  Feedback,  control,  robust,  fixed-order,  optimal. 


1 .  Int  roduct ion 


As  is  well  known,  LQR  and  LQG  controllers  lack  guaranteed  robustness 
with  respect  to  arbitrary  parameter  variations  (Refs.  1  and  2).  A  widely 
studied  approach  to  correcting  this  defect  involves  introducing  noise  into  the 
plant  via  the  imperfectly  known  parameters  (Refs.  3-10} .  Intuitively  speaking, 
the  quadratically  optimal  feedback  controller  designed  in  the  presence  of  such 
disturbances  is  automatically  desensitized  to  actual  parameter  variations.  This 
was  demonstrated  in  Ref.  11  for  the  example  given  in  Ref.  1. 

The  contribution  of  the  present  paper  is  a  generalization  of  classical 
steady-state  LQG  theory  to  include  the  effects  of  state-,  control-  and 
measurement-dependent  noise.  In  contrast  to  the  classical  solution  involving  a 
pair  of  separated  Riccati  equations,  the  necessary  conditions  for  quadratic 
optimality  in  the  presence  of  multiplicative  white  noise  consist  of  a  system  of 
two  modified  Riccati  equations  and  two  modified  Lyapunov  equations  coupled  by 
stochastic  effects.  The  coupling  serves  as  a  graphic  portrayal  of  the  breakdown 
of  the  separation  principle  in  the  multiplicative  noise  case.  When  the 
multiplicative  noise  terms  are  set  to  zero,  the  modified  Lyapunov  equations  drop 
out  and  the  modified  Riccati  equations  immediately  reduce  to  the  standard  pair 
of  separated  LQG  Riccati  equations.  Related  results  were  obtained  for  the 
discrete-time,  finite-interval  problem  in  Ref.  10. 

To  attain  further  generality,  a  constraint  is  imposed  on  controller 
order  as  in  Ref.  12.  Hence,  the  results  of  the  present  paper  also  constitute  a 
direct  generalization  of  the  coupled  system  of  modified  Riccati  and  Lyapunov 
equations  which  arise  in  characterizing  reduced-order  controllers. 

For  the  special  case  of  full-order  compensation  in  the  presence  of 
state-dependent  noise  only,  versions  of  these  equations  were  discovered 
independently  by  Hyland  (Refs.  13  and  14}  and  Mil 'stein  (Ref.  15}.  An 
interesting  difference  between  Refs.  13  and  14  and  Ref.  15  is  that  Mil' stein 
interpreted  the  plant  model  as  an  Ito  stochastic  differential  equation  whereas 
Hyland  utilized  the  Fisk-Stratonovich  definition  (Refs.  16-18) .  In  earlier  work 
on  modelling  flexible  mechanical  structures  (Refs.  19  and  20),  justification  for 
this  interpretation  as  cm  appropriate  model  for  parameter  uncertainty  was  based 
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upon  the  Maximum  Entropy  Principle  of  Jaynes  (Ref.  21)  and  the  theory  of 
stochastic  approximation  (Ref.  22).  A  summary  of  this  approach  and  its 
relationship  to  Refs.  23  and  24  can  be  found  in  Ref.  25.  Rigorous  guarantees  of 
robustness  over  a  prescribed  range  of  parameter  variations  have  been  obtained 
using  Lyapunov  functions  (Refs.  26-29).  Although  the  present  paper  utilizes  an 
Ito  model  for  simplicity,  results  based  on  Stratonovich  models  are  readily 
obtained  by  means  of  standard  transformations. 

An  immediate  practical  benefit  of  the  structured  form  of  the  necessary 
conditions  is  the  means  for  constructing  numerical  algorithms  which  differ 
fundamentally  from  gradient  search  techniques.  One  such  iterative  algorithm, 
proposed  in  Refs.  30-32,  exploits  the  characterization  of  the  oblique  projection 
as  the  sum  of  rank-1  eigenprojections  of  the  product  of  the  rank-deficient 
"pseudogramians”  satisfying  the  modified  Lyapunov  equations.  As  discussed  in 
Ref.  32,  the  necessary  conditions  fail  to  specify  which  eigenprojections 
comprise  the  oblique  projection;  indeed,  each  choice  may  correspond  to  a  local 
extremal.  In  practice,  judicious  choice  of  the  eigenprojections  can  eliminate 
extremals  with  high  cost  and  hence  efficiently  identify  the  global  minimum. 

These  issues  are  a  result  of  the  reduced-order  constraint  only;  the  stochastic 
effects  alone  do  not  appear  to  introduce  extremal  multiplicity. 

The  scope  of  the  present  paper  involves  deriving  the  optimal 
projection  equations  for  reduced-order  modelling,  estimation  and  control 
obtained  in  Refs.  32,  33  and  12  to  include  state-,  control-  and  measurement- 
dependent  noise.  The  main  results.  Theorems  2. 1-2.3,  present  the  necessary 
conditions  for  optimality  as  systems  of  2,  3,  and  4  matrix  equations  (modified 
Riccati  and  Lyapunov  equations)  coupled  by  both  the  optimal  projection  and 
stochastic  effects.  The  necessary  conditions  in  this  generality  are  presented 
here  for  the  first  time.  The  dynamic  compensation  result  supports  the  numerical 
results  obtained  in  Refs.  11  and  34.  Appendix  D  contains  the  proof  of  Theorem 
2.3;  the  proofs  of  Theorems  2.1  and  2.2  are  similar  and  hence  are  omitted. 
Although  the  derivations  in  Refs.  32,  33  and  12  utilizing  Lagrange  multipliers 
could  have  been  adapted  to  the  present  case,  we  have  devised  a  new  proof  based 
upon  Kronecker  products  which  is  thought  to  be  more  direct. 
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2.  Problem  Statement  and  Main  Results 

The  following  notation  and  definitions  will  be  used  throughout 

the  paper. 


B 

m 

& 

m 

Rax0 

m 

Ra 

m 

la 

2(i) 

Z(i,j) 

ZT 

z“T 

o(z) 

tr  Z 


11*11 

diag(«1,...,aQ() 

E. 

l 

n.w 

X  ®  Y 


expected  value 

real  numbers 

ax/3  real  matrices 
Raxl 

axa  identity  matrix 

ith  element  of  vector  Z 

(i,j)  element  of  matrix  Z 

transpose  of  vector  or  matrix  Z 

(Z1)”1  or  (Z-1)1 

rank  of  matrix  Z 

trace  of  square  matrix  Z 
1 

T  2 

(tr  ZZ  )  (Frobenius  norm) 

a»a  diagonal  matrix  with  listed  diagonal 
elements 

matrix  with  unity  in  the  (i,i)  position 
and  zeros  elsewhere 

l 

X(1,1)Y  *  *  *  X(1,/3)Y 
•  • 

•  • 

.X(a,l)Y  *  *  *  X(a,/?)Y_ 

X  e  Rax/3,  Y  €  Irx<5  (Kronecker  product. 
Refs.  35  and  36) 
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X  ©  Y 


Z* 

row.(Z) 

i 

col.(Z) 

vec(Z) 

nc<a.0)(Z) 
stable  matrix 

nonnegative-definite  matrix 
positive-definite  matrix 
semisimple  eigenvalue 
simple  eigenvalue 
group-invertible  matrix 

semisimple  matrix 

real-semis imple  matrix 
nonnegative-semisimple  matrix 


x®I/9  +  Ia®Y/} 

X  e  £«*<»,  Y  e  E*1**  (Kronecker  sum) 
group  generalized  inverse  (Ref.  37) 


ith  row  of  matrix  Z 
ith  column  of  matrix  Z 


coljCz) 


col^(Z) 


€  Z  e  Ra*P 


2(1)  *  *  *  Z(a£-«fl) 


z(a)  *  •  •  Z(a/J) 


e  r«*0,  z  e  R“/3 

sb  a 


matrix  with  eigenvalues  in  open  left  half 
plane 

symmetric  matrix  with  nonnegative 
eigenvalues  (Z>0) 

symmetric  matrix  with  positive 
eigenvalues  (Z>0) 

eigenvalue  with  equal  algebraic  and 
geometric  multiplicity 

eigenvalue  with  unity  algebraic 
multiplicity 

2 

matrix  Z  satisfying  p(Z)  ■  p(Z  ), 
i.e.,  matrix  which  is  either  invertible 
or  whose  zero  eigenvalue  is  semisimple 
(Ref.  37) 

matrix  with  semisimple  eigenvalues 
(i.e.,  nondefective  matrix) 

semisimple  matrix  with  real  eigenvalues 

semisimple  matrix  with  nonnegative 
eigenvalues 
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*>  t 


posit ive-semisimple  matrix 


semisimple  matrix  with  positive 
eigenvalues 


simple  matrix 


matrix  with  distinct  (i.e,,  simple) 
eigenvalues 


n,  m,  i,  n^,  n^,  nc>  k,  p,  q 


L,  X  ,  X  ,  X 

*  m*  e*  c 


«.  y.  ye 

A,  Aj !•••)  Ap 

B i  ••■•i  B^ 

c,  c. , ...  t  c 


A,  B  C 
m  m  m 

A  ,  B  ,  C 
e’  e*  e 

A  ,  B  ,  C 
c*  c’  c 

*,  H.  B, 


& 
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Vlt*"**Vpt’Wlt’***’wqt 


G*  V  G2 


generic  subscript  denoting  m,  e  or  c 

positive  integers;  l<n  ,n  ,n  <  n;  f,m<q 

m  e  c 

n+nr 

n,  n^,  ng,  ^-dimensional  vectors 
m ,  1,  k-dimensional  vectors 
nxn  matrices 
nxm  matrices 
ixn  matrices 


n  *“  * 

n  xm. 

Ixn 

matrices 

m  m 

m 

m 

VV 

nexi. 

kxn 

e 

matrices 

YV 

ncxA, 

mxn 

c 

matrices 

|xl,  kxk,  mxm  positive-definite  matrices 
nxn  nonnegative-definite  matrix 
nxm  matrix;  Ri"R12R2lR12 


R1  R12 
R12  R2 


>0 


kxn  matrix 

* 

standard,  independent  Wiener  processes,  t>0 
(wit*  *  *  * ,wqt)T 

mxq,  nxq,  ixq  matrices;  p(G)»m, 


I  ■<! 


vi  4ciGr°- 

-m- 


V12  ft  <!  Gj,  V2  A  G2G2  >0,  V  ft  GGT  >  0, 


6  CG1 


V  *  GG  » 


V1  V12 


yT  y 

V12  V2  J 


£0, 


B 


w*  [».]  • 


B  ft 
e 


Xn  0 


0  B 


mm 

u 

ft  B 

G, 

G 

ft  B  G.  G 

to 

.  * 

e 

e  *  c 

ft  G 

?, 

V 

ft  B  V?,  V 

t 

r 

m 

mm’  e 

-  [C 

-C 

3, 

c  ft  Cl  -c 

a 

e 

ft? 

RC  , 

R  ft  ?NC  , 

n 

m 

e  e  e* 

ft  A  ©  A 

P 

+  r 

A.  ®  A. ,  x 

im 

j  i  i  r 

A 

0 

ft 

0 

A 

m 

- 

* 

A. 

0 

«*• 

ft 

l 

,  A  .  ft 

0 

0 

ei 

• 

•m 

**  ’ 

P  - 

_  *  A  ©  A  + 

Z  A  .  ®  A  .  . 

r 

i-X  rI  rl 

B  ft 
c 


Xn  0 


0  B 


e  e  e' 


c  c  c 


C  ft 

c 


I  0 
n 


0  C 


R  ft  CTRC  , 
c  c  c’ 


A  0 


B  C  A 
e  e 


A  ft 
c 


BC 


B  C  A 
c  c 


A.  0 

i 


B  C.  0 
e  i 


A  .  ft 
ci 


A.  B.C 

l  l 


B  C.  0 
c  1 
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For  the  following  definitions,  let  Q,  P,  Q,  P  €  R  : 


»  A  P  T  A 

R2SR2  ♦  L  B?(P+P)B. , 
M  i-l  1  1 


q  ft  qct  +  v  +  l  a.(q+q)cT, 
i-l 


aq  -  A  -  2VC* 


V  ft  V2  +  £  C  (Q+Q)c!, 
i-l 


P  ft  BXP  +  aj2  +  Z  bT(P+P)A., 
i-l  1  1 


Ap  ft  A  -  BR^P. 


Using  the  above  notation  we  can  state  the  reduced-order  modelling,  estimation 
and  control  problems. 

Reduced-Order  Modelling  Problem.  Given  the  nth-order  model 


dx.  »  Ax  dt  +  z  A.x  dv .  ^  +  G,dw. , 

t  t  iml  X  t  xt  It 

yt  ■  Cxt* 


where  t  € [0,  “),  determine  an  n  th-order  model 

m 


dx  .  -  A  x  .dt  +  B  Gdw  , 
mt  m  mt  m  t 


y  „  -  C  x  .  , 
Jmt  m  mt’ 


which  minimizes  the  model-reduction  criterion 


WW  “  lim  8Up  R(yt"ymt)  ]  * 

t-»oo 
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system 


which  minimizes  the  dynamic-compensation  criterion 


JcUc*Bc'Cc>  “  Xi®  8up  i[xtRlXt+  2xtR12Ut  +  utVt] 

t"*  oo 


Clearly,  Jn,  Jg  and  Jc  are  nonnegative,  extended-real-valued 

functionals  defined  on  appropriate  Euclidean  spaces.  Explicit  expressions  for 

—  2 

these  functionals  are  now  given.  Henceforth  we  assume  that  E  |[  x  q||  <«  and  that 


x  -  and  v,^,...,v  are  uncorrelated,  t>0. 

rO  it  pt  t 


LI .  The  nonnegative-definite  covariance 


(^(t)  2  gUrt^tl»  t>0,  is  given  by 


Qr(t)  =  ArQrCt).  +  QrCt)/£  +  ^AriQr(t)A^i  +  Vr.  t  >0, 


or,  explicitly,  by 


-  _i  At  -  r  A  <r 

Q  (t)  =  vec  «.  „  (e  vec  Q  (0)  +  {  e  dcrvec  V  ), 

r  r  J  r 

K*nrl  0 


The  cost  criteria  J^,  Je  and  J£  are  given  by 


Jr(Ar,Br.Cr)  =  lim  sup  tr  Qr(t)Rr» 
t-*oo 


or,  equivalently,  by 


-  t  -r  -  f  -r 

J  (A  ,B  ,C  )  *  lim  sup  (vec  R  )  (e  vec  Q  (0)  +  /  e  dcrvec  V  ).  (19) 
r  r  r  r  . r  J  r 


Proof.  See  Appendix  A. 
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The  finiteness  and  smoothness  of  J  ,  J  and  J  clearly  depend  upon  the 
—  ~  _  _m  e  c 

interrelationships  among  0^(0),  A  ,  and  V^.  To  avoid  a  detailed  analysis  and 
to  guarantee  that  J^,  J^«  and  are  finite  and  independent  of  initial  data,  we 
restrict  our  consideration  to  second-moment  stable  or  second-moment  stabilizing 
design  triples.  Furthermore,  to  avoid  degeneracy  in  later  developments  (and 
without  loss  of  generality)  only  minimal  (i.e. ,  controllable  and  observable) 
realizations  are  admitted.  Hence,  for  the  modelling,  estimation  and  control 
problems  define  the  open  sets 

S  =  {(A  ,B  ,C  ):  A  is  stable  and  (A  ,B  ,C  )  is  minimal}. 

-r  r  r  r.  -r  r  r  r 

In  the  following  result  we  abuse  notation  slightly  and  let  denote  lim  Qr(t). 

t~*00 

Proposition  2.2.  Suppose  is  nonempty.  If  (A^.B^.C^e  then  Qr 
lim  Q  (t)  exists  and  is  given  by  the  unique,  nonnegative-definite  solution  to 

t-oo  r 


0  =  A  Q  +  Q  A1  +  f  A  .Q  AT.  +  7  , 
r  r  r  r  ri*r  rx  r 

x=l 


(20) 


or,  explicitly,  by 


-  —1  i  - 

Q  =  vec  _  -  (-A  vec  V  ) . 

r  .  .  — r  r 

(V”r> 


Hence, 


Jr(Ar.Br.Cr)  =  tr  QrRr. 


or,  equivalently. 


Jr(Ar,Br.Cr)  =  -(vec  Rr)TA~1vec  Vr* 


(21) 


(22) 


(23) 
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Proof.  See  Appendix  A. 


A e  a  side  note  we  examine  the  evolution  of  the  mean  value  of  x 


Proposition  2.3.  The  mean 


m(t)  £  ^rt*  t 


satisfies 


m(t)  =  Aro(t).  t>0. 


Furthermore,  if  (A^.B^.C^)  (  £>r  then  Af  ia  stable  and  thus 


lim  m(t)  •  0. 


Proof.  See  Appendix  A.  q 

Of  course,  it  is  useful  to  know  when  the  sets  S  ,  S  and  S  are 

~m  -e  -c 

nonempty.  Although  for  the  closed-loop  control  problem  the  question  is  complex 
because  of  stabilizability  concerns,  the  modelling  and  estimation  problems 
permit  considerable  simplification. 

Proposition  2.4.  S^  (alternatively,  S@)  is  nonempty  if  and  only  if 

A  ia  stable.  In  this  case  S  and  S  are  given  by 
”  in  — e 

S  -  {(A  ,B  ,C  ):  A  is  stable  and  (A  ,B  ,C  )  is  minimal}, 

“b  m  m  m  m  m  m  m 

S  ■  {(A  ,B  ,C  ):  A  is  stable  and  (A  ,B  ,C  )  is  minimal}. 

•6  6  «  €  €  e  e  e 
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Proof.  See  Appendix  B.  □ 

The  following  observation  concerns  the  smoothness  of  the 
cost  functionals. 

Proposition  2.5.  The  functionals  Jr  are  infinitely  Frechet 

differentiable  on  S  . 

-r 


Proof.  From  Lemma  3.7.2,  p.  203  of  Ref.  38,  it  follows  that  the  map 

-1 

W— W  defined  on  the  set  of  invertible  matrices  is  C40.  The  result  follows  from 

the  chain  rule  and  (23).  □ 

It  is  now  possible  to  proceed  with  the  principal  aim  of  the  paper 
which  is  to  characterize  solutions  of  the  reduced-order  modelling,  estimation 
and  control  problems  by  means  of  a  first-order  variational  analysis.  To  this 
end,  one  additional  assumption  is  required.  In  order  to  obtain  closed-form 
expressions  for  extremal  values  of  the  closed-loop  control  gains,  the  dynamic- 
compensation  problem  requires  the  technical  assumption 

[Bi  +  0=5>  CL  -  0],  i-1,...,  p,  (27) 

or,  equivalently, 

[Ci  f  0=>  Bi  -  0],  i-1 . .  (28) 

i.e.,  for  each  i  €  {l,...,p>,  and  are  not  both  nonzero.  Essentially, 

(27).  expresses  the  condition  that  the  control-dependent  and  measurement- 
dependent  noises  are  independent.  There  are  no  constraints,  however,  on 
correlations  with  the  state-dependent  noise. 

In  order  to  state  the  main  results  we  require  some  additional  notation 
and  a  lemma  concerning  a  pair  of  nonnegative-definite  matrices.  For  a  real- 
semisimple  matrix  X  6  &Qxn  define  the  set  of  diagonalizing  matrices 
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D(X)  ft  {*e  Rnxn:  *_1X*  is  diagonal}. 


and,  for  a  pair  of  nonnegative-definite  matrices  X,  Y  e  Rn*n  define  the  set  of 
contragredientlv  diagonalizing  matrices 

C(X,Y)  «  {'f  €  Rn*n:  and  ’i'TY'i'  are  diagonal} 

and  the  subset  of  balancing  transformations 

B(X.Y)  ft  £  C(X,Y)s  =  *TY¥}. 

The  following  result  unifies  and  extends  similar  results  found  in  Refs.  32,  33 
and  12. 

A  A 

Lemma  2.1.  Suppose  Q,  P  e  Rnx  are  nonnegative  definite  and 

AA 

p(Q P)  -  nT.  Then  the  following  statements  hold: 

(i)  0  +  C(Q,P)  C  D(QP). 

AA 

(i i)  QP  is  nonnegative  semisimple. 

(iii)  The  nxn  matrix 

Tm  QP(QP)#  (29) 

is  idempotent,  i.e.,  T  is  an  oblique  projection. 

A  A  1  A  A 

(iv)  There  exists  ’i»€C(Q,P)  with  0J'“J'QP'I')r .  . .  /  0,  i«l,...,n  ,  such  that 
T is  given  by 


T 


n^ 

£  n.(«. 

i=l  1 


(30) 


A  A  A  A 

(v)  If  p(Q)  -  p(P)  -  nr  then  B(Q,P)  *  0. 


(vi)  If  p(Q)  ■  p(P)  ■  n  then  there  exists  e  B(Q,P)  with 
_i  ~~  r  - 

QP'Dq  ^  i“l » •  •  •  ,  such  that  t  is  given  by  (30). 

A  A 

(vii)  If  p(Q)  ■  p(P)  »  ny  then 


A  A  A  /M  Am 

Q  -  TQ  -  QT  -  TQT  , 


A  *p  A  A  m  A 

p  ■  rAP  -  PT  ■  T  PT. 


(31) 

(32) 


Qj*  n  n  xn 

(viii)  There  exist  G,  T  c  R  and  positive-semisimple  M  e  R  such  that 


QP  -  G  Mr, 


(33) 


TG1  -  I  . 
nr 


(34) 


n  xn 


n  xn 


(ix)  If  G,f  <  R  r  and  fi  e  R  r  r  satisfy 


A  A  M 

QP  -  G  Mf , 


(35) 


Tgt  -  I  , 

Br 


(36) 


u  aw  . 

then  there  exists  invertible  S  e  R  r  r  such  that  G  ■  S  G,  T  -  Sr  and  M  ■ 

n  xn  n  xn 

(x)  If  G,  r  €  R  r  and  M€R  r  r  satisfy  (33)  and  (34)  then  M  is 
invertible,  (QP)^  »  G^M~*T  and 

T 

t  -  G  r. 

Proof.  See  Appendix  C. 


(37) 

□ 
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For  convenience  we  shall  call  G,  r  «  R  and  MeR  r  satisfying 

A  A 

(33)  and  (34)  a  protective  factorization  of  QP.  Furthermore,  define  the 
complementary  oblique  projection 


r.  a  I  -  r 
1  n 


and  let  J^A^.B^.C^)  denote  the  Frechet  derivative  of  evaluated  at 
(Ar,Br.Cr). 

It  is  now  possible  to  state  the  main  results,  which  provide  a 

parameterization  of  triples  (A^.B^C^)  e  for  which  the  first  Frechet 

derivative  of  J  vanishes . 
r 


Theorem  2.1.  Assume  A  is  stable.  Then,  for  (A  ,B  ,C  )  (S 

m  m  m  — in* 

J'(A  ,B  ,C  )  -  0  (39) 

m  m  m  m 

A  A 

if  and  only  if  there  exist  nxn  nonnegative-definite  matrices  Q  and  P  such  that, 

A  A 

for  some  projective  factorization  G,  M,  T  of  QP,  A  ,  B  and  C  are  given  by 

in  in  in 

A  =  TAGT.  (40) 

U 

B  -  TB,  (41) 


C  -  CG  , 
m 


and  such  that,  with  T  6  QP(QP)^  ■  G^T  and  I  -  t,  the  following  conditions 


are  satisfied: 
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(43) 


*  *  it  t  T  T 

0  =  AQ  +  QA  +  BVB  -  f^BVB  Tx. 


0  =  ATP  +  PA  +  CTRC  -  T^CTRCTa. 
p( Q)  -  p(P)  -  p(Q?)  ■  nm* 


(44) 

(45) 


Furthermore,  if  (A^.CJ  *  Sffl  satisfies  (39)  then  the  extremal  cost  is 
given  by 


J  (A  ,B  ,C  )  «  tr[(W  -Q)CiRC] 
m  mmm  c 


-  tr[(W  -P)BVBA] 
o 


(46) 


=  2tr[(QP-WcWo)A3  -  2^tr  W^W^., 


where  W  ,  W  €  Rn*n  are  the  unique,  nonnegative-definite  solutions  to 
c  o  * 


0  =  AW  +  H  A  t  VA.H  a!  +  BVB  . 

C  C  X~1  1  c  1 


o  =  atw  +  w  a  +  V'aTw  a.  +  ctrc. 

o  o  >-*  •  i  o  i 
x=l 


(47) 


(48) 


Theorem  2.2.  Assume  A  is  stable.  Then,  for  (A_.B_,C_)  €  S_, 

—  —  - . -■■■■—  —  e  e  e  — e 

■ 0  <4! 

A  A 

if  andonly  if  there  exist  nxn  nonnegative-definite  matrices  Q,  Q  and  P  such 
that,  for  some  projective  factorization  G,  M,  T  of  QP,  A^,  Bg  and  are 
given  by 
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(50) 


Ae  =  r(A-2V~1C)GT* 

B*  =  (51) 


ce  -  lgt. 

(52) 

and  such 

A  A  A  A  JL  m 

that,  with  T“  QP(QP)  •  G  T  and  ^  I  -  t,  the  following  conditions 

are  satisfied: 

0  =  AQ  +  QAT  +  Vt  +  ^Ai(Q+Q)A^  -  QVjV  +  ^gv'V7^ 

(53) 

a  *  m  T  1  m  m 

o  =  AQ  +  qaa  +  gv2  g  -  TAgv2VTi. 

(54) 

m  a  a  m  mm 

0  =  Ajp  +  PAg  +  LNL  -  r^LNLr^, 

(55) 

p(Q)  -  p(P)  “  p(QP)  -  ne. 

(56) 

Furthermore,  if  (A  ,B  ,C  )  e  S  satisfies  (49)  then  the  extremal  cost  is 
e  e  e  — e 

given  by 

J  (A  ,B  ,C  )  -  tr  QLTHL. 
e  e  e  c 

(57) 

Theorem  2.3.  Assume  (27)  holds  and  S  is  nonempty.  Then  for 

<VBcc 

)  e  S  , 
c  -c 

J'(A  ,B  ,C  )  -  0 
c  c#  c'  c 

(58) 

if  and  only  if  there  exist  nxn  nonnegative-definite  matrices  Q,  P,  Q  and  P  such 

A  A 

that,  for  some  projective  factorization  G,  M,  T  of  QP,  A  ,  B  and  C  are 

0  0  c 

given  by 


(59) 


Ac  =  rCA-BR'1?  -QV^C  )GT, 


»c  “  ra^1- 


“-1  T 

Cc  =  -r2  re*. 


(60) 

(61) 


and  such  that,  with  QP(QP)#  =  GTr  and  r  =  I n~T,  the  following  conditions 
are  satisfied: 


*-l 

*T 


0  =  AQ+QA‘+V1+^[AiQA*+(Ai-BiR2*P)Q(A.-BiI^iP)A]-5V2i-9i+-i9V219TTl. 

0  =  ATP+PA+R1+  £  [ATpAi+(Ai-9V21C.) TP (A.-QV^V) ] -P^P+r^R^P 


(62) 


(63) 


■*  "*  T  “—l  T  “—l  T  T 

0  “  ApQ  +  QAp  +  9»jY  -  T^V^gVi. 


T*  “  T*_1  T  T“-l 

0  =  Ajp  +  PAq  +  PAR2AP  -  TAPiR21Pri. 


P(Q)  «  P(P)  =  p(QP)  =  nc. 


(64) 

(65) 

(66) 


Furthermore,  if  (A ,B  .C  )  €S  satisfies  (58)  then  the  extremal  cost  is 
c  c  c  — c 


given  by 


>1. 


J  (A  ,B  ,C  )  =  tr[(Q+Q) R-  -  2R..R,  PQ 
cccc  1  Z  — 


T“— 1  l  “ 

+  l\\*2  PQ] 


(67) 


endix  A:  Proof  of  Propositions  2.1.  2.2  and  2.3 


First  note  that  (l)-(4),  (6) -(9)  and  (11) -(14)  can  be  written  as 


dx  —  A  x  dt 
rt  r  rt 


P  -  ~ 

Z 

i=l 


_ _ dv .  ^  +  G  dw  . 

rx  rt  it  r  t 


(68) 


From  Theorem  8.5.5,  p.  142  o£  Ref.  17  (or  from  the  Ito  differential  rule)  it 
follows  that  the  nonnegative-definite  covariance  Qf(t)  is  given  by  (16). 
Furthermore,  (5)*  (10)  and  (15)  are  equivalent  to  (18).  Rewriting  Q^(t)  in  the 
form  (see  Refs.  35  and  36) 


vec  Qr(t) 


=  A^vec  Qr(t)  +  vec  7^ 


leads  to  (19) . 


(69) 

□ 


To  prove  Proposition  2.2,  note  that  the  stability  of  A  implies, 

mm  mm  * 

by  (69) ,  that  Q  -  lim  Q  (t)  exists  and  is  given  by  (21) ,  which  satisfies  (20) . 
r  .  —  r 


Clearly,  Q  >  0  since  Q  (t)  >  0,  t  >  0.  Now  (22)  and  (23)  follow  from  (18)  and 
(19).  '  C  0 


To  prove  Proposition  2.3,  note  that  the  differential  equation  for  m(t) 

is  an  immediate  consequence  of  (68) .  To  show  that  A^  is  stable,  we  proceed  as 

in  Lemma  2.2  of  Ref.  4.  Repeating  the  steps  leading  to  (22)  with  replaced  by 

I~  it  follows  (see  Ref.  4)  that  (A  ,1“  )  is  stabilizable.  Hence, 
n  r  n 


t  ** 

r  A  <7  Act 

J  e  r  e  r 

0  e  ® 


dcr 


is  bounded  as  t -*• «,  which  implies  A^  is  stable. 


.9 
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•  Appendix  B:  Proof  of  Proposition  2.4 

We  require  some  elementary  properties  of  the  Kronecker  product  (Refs.  35 
and  36)  applied  to  partitioned  matrices.  For  Xe  RSxt  and  Y  €Rpxq  partitioned  by 


_  fcl 

t2 

r  ^ 

q2  _ 

81 

X  - 

X1 

X12 

P1 

,  Y  - 

Y1 

Y12 

8 2 

X21 

m 

X2  _ 

p2 

_  Y21 

Y2  . 

it  follows  that 


X®Y 


Xj  ®  Y  X12  ®  Y 


x2i®y 


X2  ®  Y 


- 

■  _ 

D  0 

Y  ®X.  Y  ®  X,  _ 

U  0 

a^p 

1  12 

qxtj 

0 

Y®X,1  Y  ®X0 

0  0 

2  P 

21  2 

q*t2 

SjXp 


0 

D 


»2*P 


Yl®xl 

Y12®X1 

Y1  ®X12 

Y12 

®X 

Y„,  ®  X. 

4-*.  1 

Y2  ®X1 

Y21®  X12 

Y2 

®X 

Y1  ®X21 

Y12®X21 

Y1  ®X2 

Y12 

®x, 

Y21®X21 

y2  ®x21 

Y21  ®X2 

Y2 

®x, 

12 

2 

2 


U  .  0 

qxtj 


qxt2  * 


where  U,  .  is  the  permutation  matrix  defined  in  Refs.  35  and  36.  Since  U  = 
-1  ixj 

(i.e.,  is  involutory),  the  stability  of  (square)  X®Y  is  equivalent  to 

the  stability  of  the  above  block  4x4  matrix.  Hence  note  that 
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f 


A  =  block-diagonal  (A,  A  ©  A  ,A  ©  A,  A  ©  A  ). 

— m  —  si  &  m  01 

If  (A  ,B  ,C  )  is  such  Chat  A  is  stable  then  clearly  A  is  also  stable  and,  by 
m  m  m  *0 

elementary  properties  of  the  Kronecker  sum,  A&  is  stable.  Conversely,  if  A  and 
are  stable  then  A^  is  stable.  The  result  for  A  is  obtained  analogously 
noting  only  that  Ag  is  lower  block  triangular. 

5 .  Appendix  C:  Proof  of  Lemma  2.1 

(i)  From  Theorem  6.2.5,  p.  123  of  Ref.  39,  it  follows  that  there  exists  an 
nxn  invertible  matrix  $  such  that  the  nonnegative-definite  matrices 
D~  &  'P“*Q'iTT  and  D*  $  4'TP'1' are  both  diagonal.  Hence  C(Q,P)  0  0.  Since 

DjJp  -  is  also  diagonal,  C(Q,P) C  D(QP). 

Aa  1 

(ii)  Since  QP  -  'i'A'f  ,  where  A  ■  is  nonnegative  diagonal,  QP  is 

nonnegative  semisimple. 

A  A 

(iii)  Since  QP  is  semisimple,  it  is  group  invertible.  By  properties  of  the 

2 

group  inverse  (Ref.  37,  p.  124),  r  =  T. 

(iv)  Note  that  by  means  of  a  basis  rearrangement,  it  can  be  assumed  that  'P 
in  (i)  is  such  that  A*  diag(X.  ,...,  A  ,0,...,0),  where 

r  #  -1-1 

^  (D^D“) .j  f  0,  i»l,...,nr.  Hence,  since  A  -  diagClj  ,...,An  ,0,...,0), 


nr 

T  =  QP(QP) #  =  iAjflT1  =  J2  'i'E.'i f1. 

i=l  1 
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(v)  Since  p(Q)  -  p(P)  -  p( QP),  it  follows  that  (D~),.  /  0, 

Q  \ l > ly 

^P(i,i)  ^  *-"l»***»nr*  Hence,  let  Aq  and  Ap  denote  the  upper  left  positive' 

diagonal  blocks  of  D*  and  Dp,  respectively,  and  define 


V  6  ijr 


(A*  A’1)4 


0 

1 

n-n 

r 


It  now  follows  that 


Am  a  A  « 


0 

0 


as  'desired. 


(70) 


(vi)  This  is  an  immediate  consequence  of  (70) . 

(vii)  This  is  an  immediate  consequence  of  (70)  and  (30) 

(viii)  With  ilr  as  in  (iv)  and  A  ^  diag(r,  , . . .  ,t  ),  it  follows  that  for 

o  in 

x 

arbitrary  invertible  S  €  Rn*n, 

A  A 

QP-* 

and  thus  (33)  and  (34)  hold  with  G  -  [ST  0],  H  -  S~*A  S  and  T“  [S-1  0]tf'r*. 

o 

(iaO  The  result  follows  from  S  ■  M_1fGTM”1  with  s’1  -  mFgTM_1. 


(S_1AS)[S_1  O]^"1 

o 


(x)  The  result  is  a  consequence  of  (viii)  and  (ix) 


6.  Appendix  D:  Proof  of  Theorem  2.3. 

First  note  that  by  arguments  similar  to  those  used  in  Appendix  A  the  dual 
of  (22)  given  by 


”T~  ~  -  P  “T  ~  “ 

0  =  A  P  +  P  A  +  r  A  .P  A  .  +  R 
r  r  r  r  ri  r  n  r 


(71) 


has  a  unique,  nonnegative-definite  solution  given  explicitly  by 


~  — 1  T  “ 

P  *  vec/-  _  .(-A  vec  R  ), 

r  r,  >  _r  r 

n  ,  n 
r  r 


(72) 


Define  the  partitionings 


<*r 


r  r  -1 

r  r 

n 

Qi 

«12 

-  n  - 

P1 

P12 

M 

n 

r 

T 

LQ12 

Q2 

*  P  » 
r 

r 

PT 
-  12 

P2._ 

where,  for  notational  convenience,  we  suppress  the  subscript  r.  Also  define  the 
notation 


PQ  - 


12 


Z21  Z2 


where 


Z1  * 

Pl«l  *  P12<2- 

Z12 

4  Vu 

+  p12q2. 

Z21  & 

P12Q1  *  p2^12 ' 

Z2 

4  P12qi2 

+  P2<V 

n  xn 

n  x  l 

mxn 

(6a  *6b 

.«c  >  €  *  c  c 

*R  C 

*  R  C. 

Ve  now 

c  c  c 
control  problem. 
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Lemma  6.1.  Under  the  assumptions  of  Theorem  2.3, 


Jc'(Ac-,c-Cc)(6i  -a»  '6C  >  -  2«(2|«a  1 
c  c  c  c 


.  2tr[(i2B^P2  .  CZT  ♦  1V12* SCiQ1Aj]P12)6B  J 

1=1  C 


♦  2tr[(Q  CcR2  ♦  Z  B  *  1. 

1=1  C 


(73) 


Proof.  From  Lemma  3.7.2,  p.  203  of  Ref.  38,  it  follows  that  the  Frechet 

w  *  -«'V 


derivative  of  the  map  W  «*•  W  *  is  given  by  6„  -*■ -W  *  •  Also,  recall  from 


Refs.  35  and  36  the  identities 


(vec  X)^vec  Y  *»  tr  X^Y, 
(X®Y)vec  2  -  vec  YZXT. 


Hence,  using  (23)  and  noting  that  V  and  R  are  independent  of  A  ,  we  compute 


9J  (A  ,B  ,C  ) 
c  c  c  c  s 
dA  A 

c  c 


vec  V 


-  U;Tvec  Rc)T[|J  ®  ©  J  Du^vec  Vc) 

cJ.  L  c- 


(vec  )C 

H 


(vec  P  ) 
c 


0  0 
0  6 


A 

c-» 


vec  Q 


•  2tr  22SA  • 
c 
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Furthermore,  noting  that 


•*  «•  •*  ■*» 

vec  V  ■  vec  B  VB  ■  (B  ®  B  )vec  V, 
c  c  c  c  c 


we  obtain 


9J  (A ,B  ,C  ) 
c  c  c  c 


(vec  P  ) 
c 


I(%'i'c)V“  Q'« 


<5g  Jve c  V 


■  (vec  P 


,  r  .  \ 

-  <«e  Pc>  l— sT - \J 

••’([v  •]•[:,« !] 


P  - 

+  x  A  .  ® 


-  (vec  P 


®[°BcCi  0°J+  [Vi  »]  * 


-  2tr  Q  P 
c 


•[v  :]'  :] 

VJ 


=  2tr  C2215b  +  2trr  (CiQiaJp12  ♦  C.Q^ 

c  1=1 


*  2tr(712P12  +  VlP2)4B 


*  2tr<VcP2  +  Q21  *  ^2+l.CiVl>P12>*B 


A  similar  computation  for  (3Jc(Ac,Bc,Cc)/9Cc)6^  yields  (73). 

c 

We  can  now  proceed  with  the  proof  of  Theorem  2.3.  Obviously,  (58) 
is  equivalent  to 


0  -  Z2  • 


T  .  _T 


o  =  p2bcv2  +  Z21C  ♦  e12<v12r£AiQ1<y- 


T  £  _T_ 


0  .  R2CcQ2  +  B  Z12  ♦  V^VlVll1 


Expanding  the  nxn,  nxnc  and  ncxnc  blocks  of  (20)  and  (71)  yields 
o  =  Aflj  +  q2at  +  v2  ♦  sccqj2  +  Q12(BCc)T 

♦  £  [A^jA*  +  B.CcQj2*2  .  AiQ12(B.Cc)T  +  B,ct,Q2(BiCc)T]. 

0  *  *«12  *  «UAI  *  BCc«2  *  «l(ScC)T 

.  £  AiQ1(BcC.)T  .  V12B^. 

1=1 

0  =  acq2  *  Q2A^  ♦  bccq12  ♦  qJ2(BcC)T  .  bc92b^. 

0  *  ATPj  *  fjA  +  Rj  +  (Bc0)TpJ2  *  P12B0C 

.  £  [A2P1Al  .  CBc0.)TP^A.  +  A^P12BcC.  .  (B0Ci)TP2BcCi. 
i=l 
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o  =  ATP,„  +  P,„A  +  (B  C)TP„  +  P,BC 
12  12  c  c  2  1  c 


P  t 

+  T  A.P.B.C  +  R,.C  , 
r*.  x  1  x  c  12  c* 


0  =  app2  +  p2ac  -  (bcc)tp12  *  p*2bcc  *  A2cc. 


Obviously,  >0  and  >  0  imply  > 0  and  R2  >  0.  Next  note  that 

#  “2 

since  (A  ,B  )  is  controllable  and  V,  >  0  it  follows  that  (A  +B  CQ.  Q  ,B  V_)  is 
C  C  u  &  C  C  1Z  z  c  z 

controllable.  Using  Q^2  =  ^12^2^2  ^e^s*  39  sad  AO),  (79)  can  be  rewritten  as 

0  =  (Ac«cCQ12Q*)Q2  .  Q2(*c«cCQ12Q*)T  ■*  B^B*.  (83) 

Now,  using  Lemma  12.2  of  Ref.  41  it  follows  from  (83)  that  is  positive 
definite.  Similarly,  P2  is  positive  definite. 

a  ^ 

Since  R_.  V  ,  Q  and  P  are  invertible,  (74) -(76)  can  be  written  as 
z  z  z  z 

-P21PI2C112Q21  =  \  •  (84) 


Bc  *  -f2ltz2icT  * 


°c  *  -^1[bTz12  *  <R12*^1Bi^lAi)Q^2^Q2, 


,T  .  v-'  «T_ 


Now  define  new  variables 


«'V  «12Q2lQl2-  P  -  P1  -  P12P2lpU- 


«  -  «12Q21<)l2- 


P  -  P  P”^P^ 
12  2  *12* 
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which  are  nxn  nonnegative-definite  matrices.  Note  that  because  of  (84),  (33) 
and  (34)  hold  with 

X  ■  Vi-  r4  (89) 

where  M  is  positive  semi simple  since 

111-1 
Q2P2  "  Q2(Q2P2Q2)Q22* 

It  is  helpful  to  note  the  identities 


5  -  q12g  -  gtq*2  -  GTQ2G,  p  -  -P12r  -  -rT*l2  «  rTP  2r.  (90) 

tGT  -  GT,  Ft  mf*  >  (91) 

Q  -  rQ,  P  -  Pr,  (92) 

QP  «  -Q12pJ2  .  (93) 

Using  (34)  and  Sylvester's  inequality,  it  follows  that 
p(G)  «  pit)  ■  p(Q12>  ■  p(Pj2)  ■  nc  which  in  turn  imply  (66). 


The  components  of  Q  and  F  can  be  written  in  terms  of  Q,  P,  Q,  P,  G 

C  0 

and  r  as 


-  Q  +  Q, 

P1 

-  P  +  P, 

(94) 

Q12 

-  Q T1, 

P12 

*  T 

-  -pgt. 

(95) 

«2 

-  ro^. 

P2 

*  T 
-  GPG  . 

(96) 
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The  gain  expressions  (60)  and  (61)  can  now  be  seen  to  be  equivalent  to  (85)  and 
(86).  Substituting  (94)-(96)  into  (77)-(82)  yields 


0  =  AQ  +  QAT  +  Vj  +  ^[A^A*  +  (Ai-BiR"1P)Q(Ai-BiR^1P)T] 

A  *  m 

+  ApQ  +  QAp, 

(97) 

“  *  n>  T-— 1  T  T  O' 

o  =  [ApQ  +  Q(iaAcG+civ2i2  )  +  gv2V]r\ 

(98) 

o  =  r((GTAcr+  gv^OQ  +  Qte^r+gv^c)1  +  gv2lgT]rT, 

(99) 

0  =  ATP  +  PA  +  R,  +  T  CaTpA.  +  (A.-QV^C.^PU.-QV^C.)] 
x  x-i  l  w  a  x  x  **  z  x 

mA  A 

+  AAP  +  PAq. 

(100) 

*  T  I  TA— 1  T 

0  =  [A^P  +  P(GaAT+  BR,  P)  +  P  R_  PjG  , 

Q  C  2  —  “  Z  - 

(101) 

0  =  G[(GTA  r+BR"1P)TP  +  p(gta  r+BR^P)  +  PTr“1P]GT. 

C  2“  C  2—  —  2  — 

(102) 

The  remaining  calculations  proceed  as  follows.  Computing  either 

(99)-lX98)  or  (102)-G(101)  yields  (59).  Inserting  this  expression  for  A  into 

T  CT 

(98),  (99),  (101)  and  102  and  computing  the  (equivalent)  equations  G  (98)  , 
GT(99)G.  (101)r  and  1^(102^  it  follows  that  GT(99)G  =  GT(98)tT  and  rT(102)r  = 
r(101)r.  Hence,  (99)  and  (102)  are  superfluous.  Furthermore,  GT(98)'1'  and  (101)r 
are  equivalent,  respectively,  to 

0  =  r[Aj,Q  +  QAj  +  gv'V],  (103) 

0  =  [aJp  +  PAq  +  PTR~1P]t.  (104) 

Finally,  to  obtain  (62)-(65)  note  that  (64)  =  (103)  +  (1G3)T  -  (103)tT.  (62)  = 
(97)  -  (64).  (65)  =  (104)  +  (104)T  -  tT(104)  and  (63)  =  (100)  -  (65).  □ 
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Robust  Controller  Synthesis  Using  tbe  Maximum 
Entropy  Design  Equations 

DENNIS  S.  BERNSTEIN  and  SCOTT  W.  GREELEY 

Abstract— This  note  present*  an  application  of  the  optimality  condi¬ 
tion*  obtained  in  |1]  for  dynamic  compensation  in  tbe  presence  of  state-, 
control-,  and  measurement-dependent  noise.  By  solving  these  equations, 
which  represent  a  fundamental  generalization  of  standard  steady-stale 
LQG  theory,  a  series  of  increasingly  robust  control  designs  is  obtained  for 
tbe  example  considered  in  (21. 

I.  INTRODUCTION 

Perhaps  the  most  significant  aspect  of  LQG  theory  is  the  explicit 
synthesis  of  dynamic  feedback  compensators.  In  practice,  however,  LQG 
suffers  from  serious  defects  concerning  closed-loop  robustness  with 
respect  to  plant  deviations.  In  particular,  LQG  controllers  may  possess 
arbitrarily  small  stability  margin  with  respect  to  parameter  variations  (2]. 

One  approach  to  correcting  this  defect  is  to  rederive  the  optimality 
conditions  for  dynamic  compensation  in  the  presence  of  state-,  control-, 
and  measurement-dependent  noise  [1].  Intuitively  speaking,  the  quadrati- 
cally  optimal  feedback  controller  designed  in  the  presence  of  such 
multiplicative  disturbances  is  automatically  desensitized  to  actual 
parameter  variations.  The  optimality  conditions  now  comprise  a  system  of 
four  matrix  equations,  specifically,  two  modified  Riccati  equations  and 
two  modified  Lyapunov  equations,  coupled  by  stochastic  effects.  This 
coupling  is  a  graphic  reminder  of  the  breakdown  of  the  separation 
principle  in  the  uncertain  plant  case.  When  the  uncertainty  terms  are 
absent,  the  equations  immediately  reduce  to  the  standard  pair  of  separated 
Riccati  equations. 

For  the  special  case  of  full-order  compensation  in  the  presence  of  state- 
dependent  noise  only,  versions  of  these  equations  were  discovered 
independently  by  Hyland  (3]-(5J  and  Mil'stein  (6].  A  crucial  feature  of 
(IJ,  [31—[51  is  the  interpretation  of  the  closed-loop  stochastic  differential 
equation  according  to  the  Fisk-Stratonovich  definition  of  stochastic 
integration.  For  modeling  flexible  mechanical  structures,  justification  of 
this  interpretation  as  an  appropriate  model  for  a  priori  parameter 
uncertainty  was  based  upon  the  maximum  entropy  principle  of  Jaynes  [  1  ] . 

A  time-varying  version  of  these  design  equations  involving  uncorrela¬ 
ted  state-  and  control-dependent  noise  has  been  given  in  [7].  The 
stochastic  interpretation  is  in  the  sense  of  Ito  as  in  (6]. 

The  purpose  of  the  present  note  is  to  summarize  the  maximum  entropy 
equations  for  full-order  dynamic  feedback  compensation.  These  equa¬ 
tions  are  then  applied  to  Doyle’s  example  (2]  to  produce  a  series  of 
quadratically  optimal  robust  controllers.  The  full  optimal  projection/ 
maximum  entropy  design  equations,  which  also  account  for  a  constraint 
on  controller  order  [1],  [8],  are  applied  to  a  more  realistic  design  problem 
in  (9J 

n.  Problem  Statement  and  Maximum  Entropy  Design 

EQUATIONS 

To  state  the  optimal  dynamic-compensation  problem,  we  require  the 
following  notation.  Let  x  €  ft",  y  G  ft1,  u  G  1im,  A,  A i,  •  •  •,  Ap  6 
ft""",  B,  Bu  B,  e  ft""m,  C,  C„  •••,  C„  €  ft'"",  R\  €  ft""", 

R\  2  0,  Rj  €  ft m"m,  Ri  >  0.  Furthermore,  let  iq,  •  ••,  vp  be  unit-inten¬ 
sity.  zero-mean,  and  mutually  uncorrelated  white  noise  processes  and  let 
w,  €  ft"  and  w2  6  ft'  be  zero-mean  white  noise  processes  with 
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intensities  K,  2  0  and  V2  >  0,  respectively,  and  cross  intensity  Vn  €  BC  =  Q_,  V ^  .  (2.7) 

W**'.  It  is  further  assumed  that  v,,  tv,  and  x(0)  are  mutually  uncorrelated. 

We  require  the  technical  assumption  that,  for  each »,  B,  *  0  implies  C,  - 

0,  i.e.,  the  control-  and  measurement-dependent  noises  are  uncorrelated.  C,  =  -  R  ^  <$>„  (2.8) 


Optimal  Dynamic-Compensation  Problem 
Given  the  controlled  system 


*m  +  2  (b  +  ^  v,B ^  u  +  tv„ 

(2.1) 

V  (c+  5J  u,c)jx+  w2. 

(2.2) 

design  an  nth-order  dynamic  compensator 

x(=AcX<+B'y, 

(2.3) 

(2.4) 

which  minimizes  the  performance  criterion 

/Mr.  Cf)*/i(^tt  ^rt  O  +  ZaMn  8»  O+’/iMri  8„  C(), 

(2. 

here 

/■Mr.  flr.  C)  ft  lira  I[Jrrif|Jr], 

/-(/<,.  flr,  O  4  lim  HZ***,,*], 

I— • 

/.(r4r.  B„  Cr)  ft  lim  I(u’*,ir]. 


and  such  that  the  following  conditions  are  satisfied: 

0-A.Q+QAI+  K,  +  £  [A.QAj 

i-l 

+  (A,-«*  J >,)<?M.  -  B,R  2,'(S‘,)r)-  CL  F  ’ 'ftf,  (2.9) 
0  =  AJr/’+/MI  +  «1  +  ^] 

i-  I 

+  M.-£L  ^'C,)r/S(A,-CL  K^'Cr)l  -  (Pftf  '’<P„  (2.10) 

0  =  -4ft<5+(3r4^+QJ^,Q.;.  (2.11) 

0  =  r4j,/5+A4o,  +  <P1rJ?^1(P,.  (2.12) 

Remark  2.1:  Letting  A,  =  0,  B,  =  0  and  C,  *  0,  /  =  1,  •  •  •  ,p,  it  can 
readily  be  seen  that  (2.1 1)  and  (2.12)  are  superfluous  and  that  (2.9)  and 
(2.10)  yield  the  standard  separated  LQG  Riccati  equations. 

Remark  2.2:  Since  R&  a  Rz,  so  that  R  £  R2  ‘,  it  is  clear  that  the 
control-dependent  noise  effectively  oppresses  the  regulator  gain  Cr. 
Similarly,  since  Fj,  a  V2f  the  measurement-dependent  noise  suppresses 
the  observer  gain  Bc.  The  effect  of  the  terms  A,QA  f  is  discussed  in  [1]  for 
modal  systems. 

m.  the  Maximum  Entropy  Design  Equations  Applied  to 
Doyle  s  Example 


To  guarantee  that  /  is  finite  and  independent  of  initial  conditions,  we 
restrict  (Ae,  B„  Cc)  to  the  (open)  set  of  second-rnoment-stabilizing  triples 

S  ft  (Mr.  B r,  Cr)  :  A,  ©  A,  +  A.  ®  A,  is  stable} 

1*1 


where  ^  and  ®  denote  Kronecker  sum  and  product  and 

7  a  r  A,  B,Cc  "1  x  /  f"  A,  BjCt  "1 

[flrC,  A'\'A  m  [a,c,  o  }■ 

A,  ft  A  +i  5)  A).  B,  ft  fl  +  i  2  AB •’  C>  -  C+5  t  C>A‘- 


For  convenience  in  stating  the  optimality  conditions,  define  the 
following  notation  for  Q,  P,  Q,  P  €  H"x": 

Rz,  ft  Rz  +  'Z  BJ(P  +  P)B{,  F-,  ft  KJ  +  £c,<e  +  <2)C’\ 

i-I  i-l 

«L  ft  QCf  +  F12  +  ^  A,(Q  +  Q)Cf,  <?,  ft  B]P+R\i^Bj(P+P)A„ 

i-l  f-l 


As  shown  in  [2],  LQG  regulators  for  the  example 

x-[j  i]  ■*-[)]  ■c-"  "• 

[J  ,Ku-0,  K,-l. 

*.=!>[  |  }]  .  *.2  =  0,  *j=l, 


have  arbitrarily  small  stability  margin  with  regard  to  variations  b  +  A6 
when  o  and  p  are  sufficiently  large  and  6=1. 

Setting  a  =  p  —  60,  it  follows  that  the  LQG  regulator  is  only  stable  for 
0.93  S  b  +  Ab  £  1.01.  Uncertainty  in  6  can  be  modeled  by  settingp  = 
l.Ai  =  0,  fli  =  (0  6| ] r,  and  Ci  =  0.  Solving  the  optimality  conditions 
(2.9M2.12)  with  6i  =  0.05,  0.10,  0.15,  and  0.20  yields  a  series  of 
increasingly  robust  controller  designs  with  respect  to  both  positive  and 
negative  variations  A6  (see  Table  1  and  Figs.  1  and  2). 

Conclusion 


Ag.  ft  A.-tLF-'c,.  An  ft  A,-B,Rl'<?„ 

Theorem  2.1:  Suppose  (A,,  Bc,  Cc)  €  S  solves  the  optimal  dynamic- 
compensation  problem.  Then  there  exist  nxn  nonnegative-definite 
matrices  Q,  P,  (J.  and  P  such  that  Ac,  B„  Ce  are  given  by 

Ar«A,-fl, -eLFj.'c,,  (2.6) 


As  demonstrated  on  the  example  of  [2],  the  maximum  entropy  design 
equations  provide  a  novel  method  for  synthesizing  robust  feedback 
controllers.  Since  the  design  equations  represen',  a  fundamental  general¬ 
ization  of  standard  LQG  theory,  the  approach  represents  an  alternative  to 
LQG-modification  techniques.  Indeed,  these  equations  are  not  intended  as 
a  device  for  recovering  the  gain  and  phase  margins  of  LQ  state-feedback 
regulators,  but  rather  as  a  method  for  designing  output-feedback  dynamic 
compensators  which  are  robust  with  respect  to  parametric  deviations  in 
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DYNAMIC  COMPENSATOR  GAINS  FOR  LQG  AND  MAXIMUM  ENTROPY 
DESIGNS  (6  »  I,  o  -  p  •»  60) 
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b»6l>  (Actual  value) 

Fig.  1.  Robustness  of  LQG  versus  maximum  entropy  designs  (bt  -  0.05,  0.1,  0.15, 

0.2). 

the  plant  model.  As  discussed  in  [10],  these  are  significantly  different 
objectives. 
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Robust  Static  and  Dynamic  Output-Feedback 
Stabilization:  Deterministic  and  Stochastic 

Perspectives 

DENNIS  S.  BERNSTEIN,  member,  ieee 


Abstract — Three  parallel  gaps  in  robust  feedback  control  theory  art 
examined:  sufficiency  versus  necessity,  deterministic  versus  stochastic 
uncertainty  modeling,  and  stability  versus  performance.  Deterministic 
and  stochastic  output-feedback  control  problems  are  considered  with 
both  static  and  dynamic  controllers.  The  static  and  dynamic  robust 
stabilization  problems  involve  deterministically  modeled  bounded  but 
unknown  measurable  lime-varying  parameter  variations,  while  the  static 
and  dynamic  stochastic  optimal  control  problems  feature  slate-,  control-, 
and  measurement-dependent  while  noise.  General  sufficiency  conditions 
for  the  deterministic  problems  are  obtained  using  Lyapunov's  direct 
method,  while  necessary  conditions  for  the  stochastic  problems  are 
derived  as  a  consequence  of  minimizing  a  quadratic  performance 
criterion.  Tbe  sufficiency  tests  are  then  applied  to  the  necessary- 
conditions  to  determine  when  solutions  of  tbe  stochastic  optimization 
problems  also  solve  tbe  deterministic  robust  stability  problems.  As  an 
additional  application  of  the  deterministic  result,  the  modified  Riccati 
equation  approach  of  Petersen  and  Hollo!  is  generalized  in  the  static  case 
ami  extended  to  dynamic  compensation. 


I.  Introduction 

THE  gain  and  phase  margins  of  full-state-feedback  LQ 
regulators  are  well  known  flj,  [21.  Although  dynamic 
output-feedback  LQG  controllers  lack  such  margins  [3J,  consider¬ 
able  effort  has  been  devoted  to  recovering  the  full-state-feedback 
properties  [4]-[6[.  A  crucial  point  discussed  in  [7j-[9]  is  that 
such  margins  may  be  meaningless  for  guaranteeing  robustness 
with  respect  to  arbitrary  plant  parameter  variations.  This  was 
demonstrated  by  means  of  a  simple  example  in  [7],  In  addition,  as 
is  well  known,  the  use  of  singular  value  bounds  to  characterize 
plant  uncertainty  contributes  directly  to  conservatism  with  Respect 
to  real-valued  structured  parameter  variations. 

For  the  parametric -uncertainty  stability  robustness  problem, 
there  exists  a  considerable  body  of  literature  (see,  e.g.,  1 10)- 
(251).  These  results  often  rely  upon  Lyapunov’s  direct  method  and 
thus  are  usually  in  the  form  of  sufficient  conditions.  Two  factors 
are  often  lacking,  however:  a  measure  of  performance  beyond 
stability  and  design  considerations  involving  controller  effort.' 

Performance  and  controller  effort  are,  of  course,  the  natural 
domain  of  stochastic  optimal  control  via  the  cost  criterion.  In 
addition,  parameter  uncertainties  can  be  directly  incorporated  into 
the  stochastic  model  by  means  of  multiplicative  white  noise  |26)- 
[40]  Heuristically  speaking,  the  performance  of  a  quadratically 
optimal  feedback  controller  designed  in  the  presence  of  such 
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is  utilized  in  |I0).  (13).  and  controller  effort  is  considered  in  (201 


multiplicative  disturbances  is  desensitized  to  actual  constant  or 
time-varying  parameter  variations.  It  should  be  emphasized  that 
the  white  noise  parameter-uncertainty  model  is  not  interpreted 
literally  as  a  physical  moael.  Rather,  the  multiplicative  noise 
model  serves  as  a  device  which  captures  the  effect  of  parameter 
uncertainty  on  the  second-moment  matrix,  and  hence  on  the 
closed-loop  performance.  From  a  practical  point  of  view,  the 
multiplicative  white  noise  model  is  extremely  tractable  since  the 
second-moment  equation  is  closed  and  the  optimal  feedback  gains 
can  be  given  explicitly  by  closed-form  expressions  involving 
solutions  of  algebraic  equations.  For  example,  the  necessary 
conditions  derived  in  [40]  for  quadratically  optimal  steady -state 
fixed-order  (i.e.,  reduced-order)  dynamic  compensation  in  the 
presence  of  state-,  control-,  and  measurement-dependent  white 
noise  involve  a  coupled  system  of  two  modified  algebraic  Riccati 
equations  and  two  modified  algebraic  Lyapunov  equations.  The 
coupling  is  due  to  both  the  optimal  projection,  which  enforces  the 
fixed-order  constraint  [41],  and  the  multiplicative  white  noise 
terms.  Unfortunately,  however,  stochastic  optimal  control  is 
predicated  upon  stability  of  the  second  moment  of  the  state  [421- 
[47),  which  may  be  weaker  than  deterministic  robust  asymptotic 
stability.  As  a  matter  of  fact,  it  has  been  shown,  rather 
surprisingly,  that  a  nominally  unstable  system  can  be  rendered 
stochastically  stable  by  multiplicative  white  noise  interpreted  in 
the  sense  of  Stratonovich  without  actually  applying  feedback 
control  [48] . 2  Hence,  there  is  no  prior  guarantee  that  a  second- 
moment  stable  optimal  controller  predicated  upon  a  multiplicative 
white  noise  model  will  provide  deterministic  robust  or  even 
nominal  asymptotic  stability. 

Three  parallel  gaps  can  thus  be  perceived  between  the  above 
approaches:  sufficiency  versus  necessity,  deterministic  versus 
stochastic  uncertainty  modeling,  and  stability  versus  perform¬ 
ance.  In  attempting  to  bridge  these  gaps  we  ask  the  following 
question:  When  is  the  solution  to  a  stochastic  optimal  control 
problem  also  the  solution  to  a  deterministic  robust  stabilization 
problem?  In  the  presenl  paper  we  show  that  our  necessary 
conditions  for  stochastic  optimality  become  sufficient  conditions 
for  deterministic  robustness  when  we  include  an  exponential 
weighting  factor  in  the  quadratic  cost  criterion.  As  shown  in  [49). 
the  weighting  factor  e1'"  leads  to  replacement  of  the  closed-loop 
dynamics  matrices 


A  +  BKC, 


BCc 

At 


1 


for  static  and  dynamic  controllers,  respectively,  by  the  shifted 
dynamics  matrices 


A  +  al„  +  BKC, 


A  +  a  /„ 
B..C 


BCc 


When  there  are  no  parametric  plan*  uncertainties,  a  right  shift  (a 


*  This  phenomenon  does  not  occur,  however,  with  the  Ito  interpretation 
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>  0)  yields  a  prescribed  stability  margin,  i.e.,  all  closed-loop 
poles  having  real  part  less  than  -  a.  Unfortunately,  a  right  shift 
alone  does  not  appear  to  provide  guaranteed  stability  robustness 
levels  with  respect  to  arbitrary  plant  variations.  Since  multiplica¬ 
tive  white  'noise  also  does  not  ensure  robustness,  the  present 
paper  goes  beyond  previous  work  by  employing  the  right  shift 
in  conjunction  with  multiplicative  white  noise  to  guarantee 
robust  stability  over  a  specified  range  of  deterministic  parame¬ 
ter  variations.  In  particular,  we  consider  perturbations  of  A,  B, 
and  C  of  the  form 

-4  +  2  o,(t)A,,  fl+  2  <ti(t)Bh  C  +  £  oMQ, 

!« I  <«l  1.1 

where  Ai,Bit  and  C,  denote  the  pattern  of  parametric  uncertainty 
in  A,  B,  and  C  and  o,(- )  are  real-valued  Lebesgue  measurable 
functions  satisfying 


7  >  0,  follows  directly  from  the  inequality 

2  a.mAjP+PA,)^  (6>/yl)P+fly,AfPAl  (1.5) 

i- 1  i-i  i- 1 

along  with  (1.2).  Inequality  (1.5)  follows  immediately  from 

2  ^yiAi-(ofi)/y)n)ln]TP[y)^Ai-(o,(t)/'t\'1)h\^0  (1.6) 

/-> 

and  oj(t)  s  Sf. 

An  alternative  approach  to  guaranteeing  robustness  of  designs 
predicated  upon  a  multiplicative  white  noise  model  is  to  interpret 
the  stochastic  differential  equation  according  to  Stratonovich 
stochastic  integration  instead  of  Ito  integration  136],  [37],  Now  the 
closed-loop  dynamics  matrices  become 


|a,(r)|s;6„  i=l,  •••,;>.  (1.1) 

In  this  formulation  the  patterns  A„  j>„  and  C,  are  assumed  to  be 
known  while  the  deterministically  modeled  uncertain  parameters 
<r,(  )  are  known  except  for  the  bounds  (1.1).  Our  principal  result 
for  both  static  and  dynamic  controllers  states  that  a  solution  of  the 
necessary  conditions  for  stochastic  optimal  control  with  exponen¬ 
tial  weighting  and  multiplicative  white  noise  provides  guaranteed 
robust  asymptotic  stability  for  parametric  variations  satisfying 
(1.1)  as  long  as 


a>\  2  (12) 

z  i-i 

where  a  is  the  right  shift  and  -y,  is  the  intensity  of  the  noise  vft) 
multiplying  Ait  B„  and  C,  in  the  multiplicative  white  noise 
formulation  of  the  stochastic  optimal  control  problem.  Clearly, 
the  rectangular  robust  stability  region  [-5,,  6,)  x  •  •  •  x  \-bp, 
bp\  in  p-dimensional  parameter  space  can  be  enlarged  by 
increasing  either  a  or  7,,  •  •  • ,  7 Note  that  for  given  values  of  o, 
7i.  •  •  • ,  yp  ( 1 .2)  does  not  define  a  unique  robustness  region  when 
p  >  1.  The  robust  stability  guarantee  holds,  however,  for 
simultaneous  parameter  variations  Oi(-),  •••,  ap(  )  within  each 
region  satisfying  (1.2). 

The  above  result  is  based  upon  the  observation  that  second- 
moment  stability  of  a  stochastic  system  with  multiplicative 
disturbances  and  right-shifted  mean  dynamics  induces  a  Lyapunov 
function  which  guarantees  robust  stability  of  a  deterministic 
system  subject  to  time-varying  parameter  variations.  This  obser¬ 
vation,  which  appears  to  have  been  previously  overlooked  in  the 
literature,  may  be  utilized  in  the  context  of  robustness  analysis  for 
linear  uncertain  systems.  In  the  present  paper  this  result  is 
developed  within  the  context  of  robust  controller  synthesis  to 
achieve  a  unified  approach  to  robust,  fixed-order  controller  design 
consistent  with  141], 

The  derivation  of  our  results  is  quite  simple  and  is  based  upon 
the  standard  quadratic  Lyapunov  function 


where 


A,  +  BSKC, 


-( 


As 

BcCs 


BsCc\ 
Ar  ) 


A*=A 2  y<AJ>  2  y<A‘B»  2  y>c>A<- 

<- 1  .-l  z;-i 

The  closed-loop  Stratonovich  correction  evident  in  A„  B„  and 
C„  which  can  negate  the  so-called  “uncertainty  threshold 
principle"  [50],  [51],  appears  to  be  crucial  for  designing 
vibration-suppression  controllers  for  flexible  structures  [37],  [38], 
[52].  Because  of  inherent  damping,  such  systems  are  usually 
nominally  open-loop  stable  with  nondestabilizing  uncertainties  so 
that  robust  stability  is  less  of  a  challenge  than  robust  performance. 
Although  conditions  under  which  the  Stratonovich  model  yields 
robust  controllers  are  beyond  the  scope  of  the  present  paper,  it 
should  be  noted  that  the  differences  between  the  two  models  arc 
far  from  trivial.  For  example,  for  frequency  uncertainties  the 
Stratonovich  correction,  which  corresponds  to  a  variable  left  shift 
rather  than  a  uniform  right  shift,  automatically  induces  a  positive- 
real  controller  for  the  high-frequency,  poorly  modeled  flexible 
modes.  Since  quadratic  Lyapunov  functions  do  not  appear  to  be 
adequate  for  guaranteeing  the  robustness  of  such  designs,  the 
majorant  Lyapunov  function  has  been  developed  [53]. 

Inasmuch  as  deterministic  robust  stability  of  stochastically 
optimal  controllers  is  guaranteed  by  right  shift/multiplicative 
white  noise  modifications  to  the  closed-loop  Lyapunov  equation,  a 
natural  question  which  arises  is  the  following.  Do  there  exist 
alternative  modifications  to  the  closed-loop  Lyapunov  equation 
which  guarantee  robust  stability?  One  possibility  which  immedi¬ 
ately  suggests  itself  is  to  replace  the  bound  (1.5)  by 


2  °M(A  f P+PA ,)  s  2  8,(PD,DJP+  EfEt)  (1.7) 


V(x)  =  xTPx  (1.3) 

where  P  is  given  by  the  modified  Lyapunov  equation 


0  =  /C77>  +  P/J  +  2aP+2  yiAlPAi+R  (1.4) 

/*  1 

where  A  is  the  closed-loop  dynamics  matrix  and  /?  is  a  closed- 
loop  weighting  matrix.  Note  that  the  third  and  fourth  terms  in 
(1.4)  correspond  to  exponential  weighting  and  multiplicative 
white  noise,  respectively.  The  result  that  V(x)  s  -y||xj|2,  with 


where  A/  =  £>,£,.  Carrying  out  full-state-feedback  control  design 
with  (1.7)  leads  to  an  alternative  generalization  of  the  standard 
algebraic  regulator  Riccati  equation.  Indeed,  a  version  of  this 
modified  Riccati  equation  has  already  been  developed  by  Petersen 
and  Hollot  [23],  [25]  as  a  means  for  designing  robust  static  and 
dynamic  controllers.  A  fourth-order  aircraft  example  considered 
in  [25]  shows  the  practical  potential  of  their  approach.  In  the 
present  paper  we  extend  the  results  of  [23],  [25]  to  more  general 
problem  formulations  encompassing  a  wider  class  of  parametric 
uncertainty  structures  within  the  context  of  static  output  feedback 
and  reduced-order  dynamic  compensation.  Most  interestingly,  the 
results  we  obtain  are  completely  analogous  to  the  static  and 
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dynamic  compensation  results  obtained  using  a  multiplicative 
white  noise  model  with  quadratic  cost.  This  raises  the  following 
interesting  question:  Does  there  exist  an  optimization  problem 
whose  necessary  conditions  coincide  with  the  Petersen-Hollot- 
type  equations?  Indeed,  our  results  were  obtained  by  optimizing 
over  the  class  of  closed-loop  Lyapunov  equations  modified  (i.e., 
robustified)  in  the  sense  of  Petersen  and  Hollot.  Full  justification 
for  this  technique  is  developed  in  [54],  [55]  where  robust 
performance  bounds  are  obtained. 


For  the  following  definitions,  let  Q,  P,  Q,  P  €  ft"*": 
*2,  4  *2+2  y,BjPBh 

/-I 

P,  4  BrP+R{2  +  2  -uBjPAt, 

i- 1 


II.  Notation  and  Definitions 
Note;  all  matrices  have  real  entries. 


M,  N' 
/,.  (  )r 
©,  ® 

®' 


IP' 

Z.  2  Zj 
Z\  >  Z2 

asymptotically  stable 
matrix 

8,  iff.  1%  p,  nc, 

A, 

x,  u,  y,  xc 

A,  Ar.  B,  Bi\  C,  Ct 


K 

A  .A, 

Ae,  Bc,  C 


real  numbers,  r  x  s  real  matrices,  R'*1 
r  x  r  identity  matrix,  transpose 
Kronecker  sum,  Kronecker  product  [56] 
r  x  r  symmetric  matrices 
r  x  r  symmetric  nonnegative-definite 
matrices 

r  x  r  symmetric  positive-definite  matrices 

z,  -  Zi  e  sr,  z,.  z2  e  S' 
z,  -  z2  e  tp',  z„  z2  e  8' 

matrix  with  eigenvalues  in  open  left-half 
plane 

positive  integers,  /  *  1,  •  •  •,  p 
n  +  ne,  n  +  nlt  i  *  1 ,  •  •  • ,  p 
n,  m,  l,  nc-dimensional  vectors 
n  X  n  matrices;  n  x  m  matrices,  /  x  n 
matrices;  i  *  1,  •••,/> 
m  x  l  matrix 

A  +  BKC,  A,  +  B,KC,  i  -  1,  •  •  p 
nc  x  nc,  nc  x  l,  m  x  nc  matrices 


[A 

\  A, 

Be' 

Lfc 

^  J 

•  LficC, 

0  J  ’ 

a  ~ 

Aa,  Aa,  Aq 
R> 

Ri 

R» 


Lebesgue  measurable  function  on 

[0,  00),  i  =  1,  ",P 

positive  number,  /  =  1 ,  •••,  p 
real  number 

A  +  ale,  A  +  al„,  A  +  a In 
state  weighting  matrix  in  58" 
control  weighting  matrix  in  Pm 
n  x  m  cross  weighting  matrix  such  that  R\ 

-  RnRj'Rh  *  0 

+  RnKC  +  ( KC)tR\2  + 

(KC)TRiKC 


Ru  4  *2+£  y,Bf(P+P)B„ 

/•I 

Pd  A  BTR  +  R^  +  jz  yjBj(P+ P\Ai, 

/•l 

+  t  y,C,(Q+Q)Cj, 

im  I 

G/  4  QCr+  Kl2+£  y^,(Q+tf)C(r, 

/•I 

^4 Pc  4  Ac  —  BRjjjPtt, 

A&  4 

m.  Static  Output  Feedback 

/l.  Static  Robust  Stabilization  Problem:  Deterministic 
Sufficiency  Theory 

Consider  the  following  problem. 

Static  Robust  Stabilization  Problem:  Determine  K  €  Kmx' 
such  that  the  closed-loop  system  consisting  of  the  controlled  plant 

■  +(B+S  ^(0B,)u(0  ,  r€[0,  oo),  (3.1.1) 


measurements 


y(t)  =  Cx{t)  , 


(3.1.2) 


A 


R>  RnCc  "1 

cf*f2  c;*2c,J 


and  static  output-feedback  law 

u(t)  =  Ky(t)  (3.1.3) 


n -dimensional  Wiener  process 

V 

incremental  covariance  of  w,  in  J3" 

W|. 

n-dimensional  Wiener  process 

Wj, 

/-dimensional  Wiener  process 

y, 

incremental  covariance  of  *V|f  in 

Vi 

incremental  covariance  of  in  J>' 

y,2 

n  x  /  incremental  cross-covariance  of 

W„,  Wj, 

V 

r  k  i 

[B'Vl,  BeVtf J 

mutually  uncorrelated  scalar  Wiener 
processes,  /  -  1,  •••,  p 

yi 

incremental  covariance  of  v„,  y<  >  0, 

/  -  1,  ••  •,  p 

X 

expected  value 

is  asymptotically  stable  for  all  measurable  (cr, ,  ■  ■  • ,  a„):  [0,  oo)  -* 
K'’  satisfying 

|oi(r)|s5„  f€[0,  oo),  i*l,  (3.1.4) 

Remark  3.1.1:  The  nominal  stabilization  problem,  i.e.,  the  case 
in  which  parameter  uncertainties  are  absent,  can  be  recovered  by 
setting  A,  «  0  and  B,  =  0.  All  of  the  results  in  this  paper  can 
readily  be  specialized  to  this  case.  For  brevity,  however,  the 
details  are  omitted. 

Remark  3.1.2:  The  symmetric  bounds  (3.1 .4)  are  for  conven¬ 
ience  only.  The  constraints 

0/SM<)s4(,  f€[0,  oo),  i-l,  •••,/>  (3.1.4)' 

can  be  recast  in  the  form  (3.1 .4)  by  redefining  A  and  B.  Further 
notational  simplification  is  possible  by  scaling  A,  and  B,  so  that  6, 
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=  1,  /  =  1,  •••,  p.  For  clarity,  however,  we  choose  not  to  do  B.  Static  Optimal  Control  Problem:  Stochastic  Necessity 
this.  Theory 

Remark  3.1.3:  Standard  existence  theory  guarantees  that  the 

absolutely  continuous  solution  *(  • )  of  (3 . 1 . 1 )  exists  on  (0,  oo)  for  We  now  turn  to  the  static  optimal  control  problem  with  state- 
all  K  €  (a"**'  and  for  all  measurable  (o,,  •••,  a„)  satisfying  dependent  and  control-dependent  white  noise  and  exponentially 
(3 . 1 .4) .  weighted  quadratic  cost . 

The  robustness  results  are  based  upon  the  following  easily  Static  Optimal  Control  Problem:  Determine  K  G  Kmx,such 
proved  theorem  which  concerns  the  construction  of  a  Lyapunov  that,  for  the  closed-loop  system  consisting  of  the  controlled  plant 
function  for  robust  stability. 

Theorem  3.1.1:  Let  K  G  and  assume  there  exist  *L 

dXi=Ax,dt+2j  Aix,dv,i  +  Bu,dt 
(3.1.5)  /-i 


P€3>\  (3.1.6) 

Mi,Nieii"^n,  i=  1,  p  (3.1.7) 

such  that 

MT N,  +  NfMi=AfP  +  PA, ,  »=1,  •••,/>,  (3.1.8) 

0  =  ATP+PA  +  <HP)  ,  (3.1.9) 

2  ZAMjMi  +  NjN,) <  +(P)  .  (3.1.10) 

I  - 1 

Then  K  solves  the  static  robust  stabilization  problem. 

Proof:  Using  (3.1.8),  compute  for  t  G  [0,  oo)  and  /  =  1, 
•  ••,/>, 

Os[5‘/2A/, - 6-  U2a,(t)N,] T[h)nM,  -  fir  >'2a,( t)N) 

=  biMjM, + fir  'aJ(t)NjN  -  oADIMjN  +  NjM,) 

* 6. lM]Mi + NfN,]  -  o,V)[AfP  +  PA,]  . 


+  2  B,u,du„  +  e~a'dw,,  /6[0,  oo),  (3.2.1) 

I- 1 

measurements 

y,=  Cx, ,  (3.2.2) 

and  output-feedback  law 

u,  =  Kylt  (3.2.3) 

the  performance  criterion 

Ja(K)  £  lim  £e2a,[xJ'Rix,  +  lxfPilu,+  ufR1u,\  (3.2.4) 
is  minimized. 

Remark  3.2.1:  The  exponential  time  weighting  of  the  distur¬ 
bance  noise  in  (3.2.1)  is  required  to  balance  the  exponential 
weighting  in  the  cost  (3.2.4).  It  has  no  physical  significance  as 
such. 

To  develop  necessary  conditions  for  this  problem,  K  must  be 
restricted  to  the  jet  of  second-moment-stabilizing  gains 


Thus, 

a,(t)[AjP  +  NjN,), 

f€|0,  oo),  i=l,  •  •• ,  p.  (3.1.11) 
Defining  the  Lyapunov  function 

V(x)  k  x  TPx 

its  derivative  along  solutions  x (t)  of  (3.1.1 )— (3. 1 .3)  is  given  by 


S„  £  ®  Aa 

p 

+  2  1iA,  ®  A,  is  asymptotically  stable 

<•  i 

For  the  shifted  plant  dynamics.  The  requirement  K  G  S0  implies 
the  existence  of  the  steady-state  nonnegative-definite  covariance 
Q  £  lim,_„  £]e2a'xrxj].  Furthermore,  Qis  the  unique  solution  to 
the  modified  Lyapunov  equation 


K(jr(/))  =  x(/)  TPx(t)  +  x(t)  TPx(t) 

=  x(t)T\ArP+P4]x(i) 

+x«)T  [^2  °«){ATP+PA,)^x(n. 

Using  (3.1.9)  and  (3.1.1 1)  >  elds 

V(x(t))<  -x(ty  U,-2M^  +  W,1  x(t)  . 


0  =  AaQ+QATo  +  '2,yiA,QAl+V.  (3.2.5) 

i  ■  I 

An  additional  technical  assumption  is  that  K  be  confined  to  the  set 

SQ*  £  {AGS,,: CQCT> 0,  where  Q  satisfies  (3.2.5)}  . 

The  positive  definiteness  condition  holds,  for  example,  when  Q  is 
positive  definite  and  C  has  full  row  rank. 

Theorem  3.2.1:  Suppose  AGS*  solves  the  stai  .  optimal 
control  problem.  Then  these  exist  P,  Q  G  such  that  A  is  given 
by 


By  (3.1.10),  there  exists-*  >  0  such  that  V(x(t))  £  -y||jr(i)||:,  K=  -  R  ^'PSQCT(CQCT)-'  (3.2.6) 

t  G  (0,  oo),  as  required.  □ 

Remark  3.1.4:  As  will  be  seen  in  later  sections,  this  result  is  and  such  that  P  and  Q  satisfy 
applied  by  choosing  M ,  and  N,  to  satisfy 

p 

NjM,  =  PA,  (3.1.12)  0  =  AZP+PAa+'£/yiATPAl  +  Rl 

i-i 


so  that  (3.1.8)  holds  The  bound  ♦  is  then  constructed  to  satisfy 
(3.1.10; 


-P]R*P,  +  *\PTsRL'P.fi. 


(3.2.7) 
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+  S  -i,(A,-BiR^P,f)Q(Ai-B,R  *'/>,  t)T+  V  (3.2.8) 

/-i 

where 

f  A  QCT(CQCT)-'C,  fA  A  I,-t.  (3.2.9) 

Proof:  First  note  that  from  (49]  it  follows  that  the  exponen¬ 
tial  factors  in  (3.2.1)  and  (3.2.4)  are  equivalent  to  replacing  A  by 
Aa.  From  (57,  Theorem  8.5.5,  p.  142].  it  follows  that  the  state 
covariance  Q(t)  A  1[ e^Xixf]  satisfies 

6(0 +  <?«*!+£  y,AlQ(t)AJ+  V. 

i-i 

Since  K  E  S0,  Q  A  lim,-.  Q(t)  exists,  is  nonnegative  definite, 
and  is  the  unique  solution  to  (3.2.5).  Note  that 

Ja(K)  QR. 

Now  define  the  Lagrangian 

L(Q,  K)  A  tr  |\q£ +(AaQ  +  QATa  + Jj  y,A,QAJ  +  K)pJ 
with  multipliers  X  2  0  and  P  €  08"*",  and  compute 
3L/dQ=AZP+PAa+j?  y,AfPA,  +  \R. 

i~t 

Setting  3L/3Q  -  0,  \  -  0  implies  P  =  0  since  K  6  S„.  Hence, 
without  loss  of  generality  set  X  =  1  so  that 


0=AZP  +  PAa+'2y,AjPAi  +  &.  (3.2.10) 

>•1 

Since  P  is  the  (unique)  steady-state  covariance  of  the  dual  system, 
it  is  nonnegative  definite.  Also,  since  S  *  is  open,  evaluating  dL/ 
dK  =  0  yields 

0  =  R2sKCQCt+P,QCt  . 

Since  K  €  S*,  CQCT  is  invertible,  and  hence  (3.2.6)  holds. 
Finally,  (3.2. if)  is  equivalent  to  (3.2.5)  and.  performing  some 
algebraic  manipulation,  (3.2.7)  is  equivalent  to  (3.2.10).  □ 

Remark  3.2.2:  Because  R&  Sr  Ri,  and  thus  /?  £I'  £  R^  \  the 
gain  K  in  (3.2.6)  leads  to  a  net  decrease  in  controller  authority  due 
to  the  control-dependent  noise.  For  problems  which  are  open-loop 
stable  and  which  remain  stable  under  plant  variations,  (his  is  an 
intuitively  expected  consequence  of  parameter  uncertainty. 

Remark  3.2.3:  Theorem  3.2.1  generalizes  and  unifies  several 
previous  results.  In  particular,  the  noise  correlation  and  output 
feedback  constraint  constitute  generalizations  of  [26]-(33].  Fur¬ 
thermore.  because  of  the  presence  of  multiplicative  noise,  the 
results  of  (58],  (59]  are  extended.  The  role  of  the  oblique 
projection  f  has  been  discussed  in  [58],  (59].  Connections  with  the 
oblique  projection  r  arising  in  the  dynamic -compensation  problem 
(14]  are  discussed  in  [60], 

C.  Sufficiency  Meets  Necessity:  A  Marriage  of  the 
Deterministic  and  Stochastic 

We  now  answer  our  main  question:  Can  a  feedback  law 
predicated  on  a  stochastic  multiplicative  noise  model  provide 
guaranteed  deterministic  robust  asymptotic  stability?  The  answer 
is  “yes”  provided  the  exponential  is  of  sufficient  magnitude. 


Theorem  3.3.1:  Suppose  there  exists  PEP"  and  Q  €  SJ* 
satisfying  CQCT  >  0,  (3.2.7)— (3.2.9)  and 

0<(2a-£*  (3.3.1) 

/-I 

where  K  in  A  is  given  by  (3.2.6).  Then  K  solves  the  static  robust 
stabilization  problem. 

Proof:  In  Theorem  3.1.1  define 

*(P)  =  2a/>+2  y,AjPA,+fi, 

(•  1 

Mj = (t//5() l/1Pl/1Ai,  (6</ yi)l/2P'n. 

Note  that  (3.1.5)-(3.1.8)  hold.  Furthermore,  because  of  the 
equivalence  of  (3.2.10)  and  (3.2.7),  it  follows  that  (3.1.9)  is 
equivalent  to  (3.2.7).  Finally,  (3.1.10)  is  a  consequence  of 
(3.3.1).  □ 

Remark  3.3.1:  Note  that  (3.2.7)-(3.2.9)  serve  to  construct  a 
Lyapunov  function  guaranteeing  robust  stability.  Hence,  it  is  not 
necessary  to  actually  verify  that  K  E  S  *. 

By  strengthening  (3.3.1)  the  following  simplification  is  imme¬ 
diate. 

Corollary  3.3.1:  Suppose  there  exists  PEP"  and  Q  E  S9" 
satisfying  CQCT  >  0,  (3,2.7)-(3.2.9)  and 

a>[  t,  (3-3.2) 

i  lm  1 

Then  K  given  by  (3.2.6)  solves  the  static  robust  stabilization 
problem. 

It  is  interesting  to  note  that  the  feedback  gain  given  by 
Corollary  3.3.1  may  be  an  extremal,  i.e.,  local  minimum,  local 
maximum,  etc. ,  and  not  necessarily  a  solution  of  the  static  optimal 
control  problem.  The  result  is  valid,  however,  for  all  extremals  of 
the  optimization  problem.  By  specializing  Corollary  3.3.1  to  a 
solution,  i.e.,  global  minimum,  of  the  optimal  control  problem, 
we  can  bridge  the  gap  between  sufficiency  and  necessity. 

Corollary  3.3.2:  Suppose  K  E  Sa  solves  the  static  optimal 
control  problem  where  a  satisfies  (3.3.1),  and  suppose  that  the 
corresponding  solution  P  of  (3.2.7)  is  positive  definite.  Then  K 
also  solves  the  static  robust  stabilization  problem. 

IV.  Dynamic  Output  Feedback 

A.  Dynamic  Robust  Stabilization  Problem:  Deterministic 
Sufficiency  Theory 

Consider  the  following  problem. 

Dynamic  Robust  Stabilization  Problem:  Determine  (Ac,  Bc, 
Cc)  such  that  the  closed-loop  system  consisting  of  the  controlled 
plant  (3.1.1),  measurements 

y(/)=  (c+t  <7,(/)C,)  x(t)  (4.1.1) 

and  dynamic  output-feedback  law 

xc(t)  =  AeX'(t)  +  Bcy(t) ,  (4.1.2) 

u(f)-Crxr(r)  (4.1.3) 

is  asymptotically  stable  for  all  measurable  (o,.  ,  ap):  [0,  <*>)  -» 

W  satisfying  (3.1.4). 

Remark  4.1.1:  Note  that  the  problem  statement  places  no 
restriction  on  the  order  n(  of  the  dynamic  compensator.  Also,  we 
now  permit  uncertainties  in  the  observation  matrix  C  by  including 
perturbations  e,{t)Ci  in  (4. 1 . 1). 
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The  following  result  is  completely  analogous  to  Theorem  3.1.1.  Lemma  4.2. I:  If  Q,  P  €  M"  and  rank  QP  -  rtn  then  there 
Theorem  4.1.1:  Given  (Ac,  Bc,  Cf)  assume  there  exist  exist  C.T  6  and  invertible  M  €  Jlnc*”c  such  that 


(4.1.4) 

PeP*.  (4.1.5) 

Kii,  f},en*'x*,  i=l,--,p  (4.1.6) 


QP=gtmt, 

TGT=I,C. 


(4.2.7) 

(4.2.8) 


such  that 


Mit  Nj€$l*ix*,  i=l,  *”,p  (4.1.6)  Furthermore,  G.Af,  and  Tare  unique  modulo  a  change  of  basis  in 

K"cx*c. 

Proof:  The  result  is  an  immediate  consequence  of  [61, 
.  =  a  Theorem  6.2.5,  p.  123].  □ 

M|.  Nj + /v .  Mj =AjP+ PAt ,  i=l,  (4.1.7)  Note  that  because  of  (4.2.8),  the  n  x  n  matrix  r  =  G7T  is 

=T6  es  ,  .  idempotent,  i.e.,  tj  =  t.  Since  t  is  not  necessarily  symmetric,  it 

A  P+PA  +  9(P),  (4.1.8)  is  an  oblique  projection. 

p  Theorem  4.2.1:  Suppose  (4.2.6)  holds  and  (Ac,  Bc,  Cc)  E  D„ 

V  6l(\iTj(ii+  NtN,)<$(P).  (4.1.9)  solves  the  dynamic  optimal  control  problem.  Then  there  exist  Q, 

,» ,  '  P,  (5,  P  E  JO"  such  that  Ac,  Bc,  Cc  are  given  by 


Then  (Ac,  Bc,  Cc)  solves  the  dynamic  robust -stabilization 
problem. 


AC  =  T(A  - BR ^Pp-Qay^lC)GT,  (4.2.9) 


B.  Dynamic  Optima I  Control  Problem:  Stochastic  Necessity  Bc  • 

Theory 

Cc—  —R  ~lPdGT 

We  now  consider  the  dynamic  optimal  control  problem  with  c  u 

state-,  control-,  and  measurement-dependent  white  noise  and  .  n  , 

exponentially  weighted  quadratic  cost.  The  optimization  is  per-  8X1(1  such  1X181  *?■  “•  Q>  P  satisfy 
formed  over  the  class  of  dynamic  compensators  of  fixed  order  nc  r 

^  ft  ^  | 

Dynamic  Optimal  Control  Problem:  Determine  (Ac,  Bc,  Cc)  0=A°Q+  QA  l+  +  2  7/  1  A,QA  J+  (. 
such  that,  for  the  closed-loop  system  consisting  of  the  controlled  1  L 

Pl8nX  b  n  - 1  r»  vT 1  b  _  . 


(4.2.10) 


(4.2.11) 


dx,  m  Ax,dt  +  J  AjX,dvu  +  Bu,dt 


+  £  B.ucdv,,  +  e~a'dwllt  tE  [0,  «)  (4.2. 1) 


measurements 


0=AaQ+QAl+  +  £  y,  \AlQAT+(Ai-BiRu,P<l)G(Ai 
*  '**  L 

-B„R  *’/>,)  H -QdV^QT+T^QdVjQTT^,  (4.2.12) 

0=/t^+/Vla  +  /?,  +  5;  y,  \AjPAi+(Ai-QltVu'Ci)TP(Ai 

M  L 

u  1 

-QeVu'C,)  l-PHRu'Pd+rlpTRu'PdT^  (4.2.13) 


dy,  =  Cx,dt  +  '£  C,x,dv„  +  e~°'dw1,  (4.2.2) 


0=APaQ  +  QATPa  +  QdVi]Ql-rxQdVl}QlT\,  (4.2.14) 


and  dynamic  output-feedback  law 


dxcl  =  AcXc,dt  +  Bedy„ 


0  =  A  7aP+  PAqc  +  PTdR  -JPd -  r  \PTdR  2d  P d* x  ,(4.2.15) 
rank  Q- rank  P- rank  QP=nc  (4.2.16) 

(4.2.3)  (4.2.7)  and  (4.2.8),  where 


u,  =  Ccxc, 


(4.2.4) 


r  4  Grr,  rx  4  /„- r  . 


(4.2.17) 


the  performance  criterion 


Ja(Ac,  Be,  Cc)  4  iim  '^'{xjR.x, 


Proof:  As  in  the  proof  of  Theorem  3.2.1  we  note  that  the 
exponential  factors  in  (4.2.1),  (4.2.2),  and  (4.2.5)  are  equivalent 
'  to  replacing  A  and  Ac  by  A  +  al„  and  Ac  +  a/„r,  respectively. 

Theorem  4.2.1.  now  follows  immediately  from  140,  Theorem 
+  2x,  RnUr  +  u,  Riu,]  (4.2.5)  2.3],  It  need  only  be  noted  that  (4.2.9)  follows  from 


is  minimized. 

To  develop  necessary  conditions  we  restrict  (Ac,  Bc,  Cc)  to  'he 
set 


Ac  +  a/„f  =  -  BR  u[Pd  -  Qd  ^'C)Cr 

and  the  fact  that  r/t„Gr  =  TAG7  +  alKc  because  of  (4.2.8). 
C.  Sufficiency  Meets  Necessity:  The  Dynamic  Case 


6  Bc,  Cc):A„  0  Aa+  2J  yj,  ®  4,  is  c  Sufficiency  Meets  Necessity:  The  Dynamic  Case 

asymptotically  stable  and  (Ac,  Bc,  Ce)  is  minimal]  We  now  brid8e  the  8aP  ^tween  sufficiency  and  necessity  for 

j  dynamic  controllers. 


and  invoke  the  technical  assumption 


Theorem  4.3.1:  Assume  (4.2.6)  holds  and  suppose  there  exists 
Q,  P,Q,Pe  ST  satisfying  (4.2.12)-(4.2.!7),  (4.2.7),  (4.2.8), 


[4*0-00],  »=!,  •••,/>.  (4.2.6) 


The  following  lemma  will  be  needed. 


P+P  -PG1 
-OP  GPGT 


(4.3.1) 
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r 


0<[2a-'£S?/yl)  fi+M.  (4.3.2) 


Then  (Ac,  Be,  Ce)  given  by  (4.2.9M4.2.11)  solves  the  dynamic 
robust  stabilization  problem. 

Remark  4.3.1:  Note  that  P  is  always  at  least  nonnegative 
definite  since 

> 

Proof  of  Theorem  4.3.1:  As  shown  in  [40],  (4.2.6)- 
(4.2.17)  are  equivalent  to 

0  =  AZP+PAa+  2  yJjPA.  +  R,  (4.3.4) 


0  =  J*G  +  QaI+Y  yJiQA  ,r+  P  (4.3.S) 

i-  1 

where 

0_\<2+Q  (?rr  1 
Q~  l  yQ  r(JrrJ  • 

The  result  now  follows  from  Theorem  4.1.1  as  in  the  proof  of 
Theorem  3.3.1.  □ 

Remark  4.3.2:  As  in  Corollary  3.3.1  the  inequality  (4.3.2)  can 
be  replaced  by  the  stronger  condition  (3.3.2). 

V.  The  Petersen-Hollot  Approach  to  Robust  Stabilization 
A.  Static  Output  Feedback 

The  deterministic  Riccati  equation  approach  of  Petersen  and 
Hollot  is  based  upon  factoring  A,  and  B,  as 

Ai^D,E„  B,-D,Fi,  /«*!,  •",/?  (5.1.1) 

where D,  G  Ifl"*"*,  E,  G  Si"'*",  and  F,  G  jr'xm.  Obviously,  such 
a  factorization  may  not  be  unique,  and  the  nonuniqueness  is  an 
element  of  the  sufficiency  test.  To  state  the  sufficiency  condition 
we  shall  require  the  notation 

Rj,  4  b'F!F'  P„  4  BTP  +  RTn  +  Y,  b<FJE« 


Qo~qct+  y, 2.  d  4  y,  S'D'D[> E  =  2  6iEiE‘  ■ 

i-i  <-i 

Theorem  5.1.1:  Assume  there  exist  PEP"  and  Q  G  J3" 
satisfying  CQCr  >  0, 

0  =  A  rP+  PA  +  PDP  +  R,  +  £-  PjR  *>,-(-  t\PtqR  *Pef  a  , 

(5-1.2) 

0  =  (A  +  DP-  SR  £,'Paf)Q  +  Q(A  +DP-BR  *P4f)r+  V 

(5.1.3) 


and 


*>0 


(51.4) 


where  f  is  given  by  (3.2.9)  and  K  in  R  is  given  by 

*=  -RuP.QCT(CQCT)-'  .  (5.1.5) 


Proof:  In  Theorem  3.1.1  define 


#(P)  -  +  £  &M£i + F‘KC^ r<E‘ + F‘KC) * PD0JP], 


Mi =E,  +  FjKC,  Ni  =  DJP 

so  that  (3. 1 .5)— (3. 1 .8)  hold.  Note  that  (5.1.2)  and  (5.1.3)  are 
equivalent  to  (3.1.9).  Finally,  because  of  (5.1.4),  (3.1.10)  is 
satisfied.  □ 

Remark  5.1.1:  Theorem  5.1.1  generalizes  (25,  Theorem  3.3] 
in  four  distinct  ways.  First,  in  [25],  the  uncertainties  A  and  B  are 
assumed  to  be  independent.  In  our  setup  this  corresponds  to  the 
additional  condition  that  A,  *  0  implies  B,  =  0.  In  this  case 
(5.1.1)  is  satisfied  with  either  £,  =  0  or  f,  =  0  for  each  i. 
Second,  in  [25],  A ,  and  B,  are  confined  to  have  unit  rank.  This 
would  be  the  case  if  we  required  nt  =  1  in  (5. 1.1).  Third,  in  [25], 
Ri2  =  0.  And,  fourth,  the  results  of  [25]  apply  only  to  die  state- 
feedback  case.  i.e.,  C  =  /„.  In  this  case  (5. 1 .3)  is  superfluous  and 
T  -  In 

B.  Dynamic  Output  Feedback 

We  now  extend  the  Petersen-Hollot  approach  to  reduced-order 
dynamic  compensation.  Our  only  constraint  is  that  we  do  not 
permit  uncertainty  in  the  observation  matrix.  Define 


Ap  &  A-BRZ'P.,AQ  4  A  -Q.V^C. 

Theorem  5.2. 1:  Assume  C,  -  •  •  •  =  Cp  *  0  and  suppose 
there  exist  Q,  P,  Q,  P  €  J3"  satisfying 

0=  [A +  D(P+ /*)](?+ Q[A  +D(P+/s)]r 

+  yi-Q.y;lQl+T1Q.vi'QiTi,  (5.2.D 

0  =ATP+PA  +  Rt+E+  PDP- PJR  i'p,  +  ttJ>IR  i'P.Tj. , 

(5.2.2) 


0  =  (A„+ DP)0+  Q(Ap+DP) r+  <2, y; 'Ql- rx Q. V; ' Qt,t\, 

(5.2.3) 

0  =  ( A  0  +  DP)  TP  +  P(Aq  +  DP)  +  PDP 

+  PT.RuP.-TTiPTaR-u'P'T„  (5.2.4) 
(4.2.7),  (4.2.8).  (4.2.16).  (4.3.1).  and 

I"  *.  -RnR;JP,GT  1 

L  -  CpT.R  u  R  n  CParR  „'R2R  to'P.G r\  >0- 

Then  (Ar,  Bc,  Cj)  given  by 

Ac  =  T(A  -  Q,  V2  'C - BR  'Jp,  +  DP)GT,  (5.2.5) 

B'  =  TQaV;\  (5.2.6) 

Cc=-R^P.GT  (5.2.7) 


solves  the  dynamic  robust  stabilization  problem. 

Proof:  In  Theorem  4.1.1  define 

l(P)  =  P+Yl6,{l:TEl  +  P5lbfP),  $i-5jP, 
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and  note  that  <5.2.2)  and  (5.2.4)  correspond  to  (4.1.8).  Also,  note 
that  (5.2.1)  and  (5.2.3)  correspond  to 

0«(/f  +'%6l&l5(P)Q+Q(A  +  '2l6l5iDTP)r+V.  □  (5.2.8) 

/-i  i-t 

Remark  5.2.1:  Theorem  5.2.1  was  discovered  by  optimizing  J 
-  tr  Pv  subject  to 

0~AtP+PA  +/?+£  S.lPfii  +  P&DfP]  (5.2.9) 

/-i 

and  using  the  techniques  of  [40],  [41].  As  shown  in  [54],  this 
approach  also  yields  robust  performance  bounds. 


Acknowledgment 

The  author  wishes  to  thank  Prof.  C.  V.  Hollot  for  numerous 
helpful  discussions  and  for  carefully  reviewing  the  original 
manuscript  of  the  paper. 


References 

[1]  P.  K.  Wong  and  M.  Athans,  "Closed-loop  structural  stability  for 
linear-quadratic  optimal  systems,"  IEF.E  Trans.  Automat.  Contr., 
vol.  AC-22,  pp.  94-99,  1977. 

[2]  M.  G.  Safonov  and  M.  Athans,  "Gain  and  phase  margin  for  multiloop 
LQG  regulators,"  IEEE  Trans.  Automat.  Contr.,  vol.  AC-22,  pp. 
173-179.  1977. 

[3]  J.  C.  Doyle,  “Guaranteed  margins  for  LQG  regulators,"  IEEE  Trans. 
Automat.  Contr.,  vol.  AC-23,  pp.  756-757,  1978. 

[4]  J.  C.  Doyle  and  G.  Stein,  "Robustness  and  observers,”  IEEE  Trans. 
Automat.  Contr.,  vol.  AC-24,  pp.  607-611,  1979. 

[5]  — — ,  “Multivariable  feedback  design:  Concepts  for  a  classical/ 
modem  synthesis,”  IEEE  Trans.  Automat.  Contr.,  vol.  AC-26,  pp. 
4-16,  1981. 

[6]  G.  Stein  and  M.  Athans,  "The  LQG/LTR  procedure  for  multivariable 
feedback  control  design,"  IEEE  Trans.  Automat.  Contr.,  vol.  AC- 
32.  pp  105-114.  1987. 

[7]  E.  Soroka  and  U.  Shaked,  “On  the  robustness  of  LQ  regulators,” 
IEEE  Trans.  Automat.  Contr.,  vol.  AC-29,  pp.  664-665,  1984. 

[8]  U  Shaked  and  E.  Soroka,  “On  the  stability  robustness  of  the 
continuous-time  LQG  optimal  control,"  IEEE  Trans.  Automat. 
Contr.,  vol  AC-30,  pp.  1039-1043,  1985. 

[9]  M.  Tahk  and  J.  L.  Speyer,  "Modeling  of  parameter  variations  and 
asymptotic  LQG  synthesis,"  in  Proc.  25th  IEEE  Conf.  Decision 
Contr.,  Athens,  Greece.  Dec.  1986.  pp.  1459-1465. 

[10]  S.  S.  L.  Chang  and  T.  K.  C.  Peng.  "Adaptive  guaranteed  cost  control 
of  systems  with  uncertain  parameters,"  IEEE  Trans.  Automat. 
Contr.,  vol.  AC-17,  pp.  474-483,  1972. 

[11]  R  V.  Patel,  M.  Toda.  and  S.  Sridhar,  "Robustness  of  linear  quadratic 
state  feedback  designs  in  the  presence  of  system  uncertainty,”  IEEE 
Trans.  Automat.  Contr.,  vol.  AC-22,  pp.  945-949,  1977. 

[12]  A.  M.  Meilakhs.  "Design  of  stable  control  systems  subject  to 
parametric  perturbation,”  Automat.  Remote  Contr.,  pp.  1409-1418. 
1979. 

[13] -  A.  Vinkler  and  L.  J.  Wood,  "Multistep  guaranteed  cost  control  of 

linear  systems  with  uncertain  parameters,’”/.  Cuid.  Contr.,  vol.  2, 
pp.  449-456,  1979. 

[14]  M.  Eslami  and  D.  L.  Russell,  “On  stability  with  large  parameter 
variations:  Stemming  from  the  direct  method  of  Lyapunov,”  IEEE 
Trans.  Automat.  Contr.,  vol.  AC-25,  pp.  1231-1234,  1980. 

[15]  M.  Corless  and  G.  Leitmann,  “Continuous  state  feedback  guaranteeing 
uniform  ultimate  boundedness  for  uncertain  dynamic  J  systems.” 
IEEE  Trans.  Automat.  Contr.,  vol.  AC  26,  pp.  1139-1144,  1981. 

[16]  I.  S.  Thorp  and  B.  R.  Barmish,  "On  guaranteed  stability  of  uncertain 
linearsystemsvialinearcontrol,”/.  Optimiz.  Theory  Appl.,  vol.  35, 
pp.  559-579,  1981. 

[17]  E.  Noldus,  "Design  of  robust  state  feedback  laws,”  Int.  J.  Contr., 
vol  35,  pp.  935-944,  1982. 

[18]  B.  R.  Barmish,  1.  R.  Petersen,  and  A.  Feuer,  "Linear  ultimate 
boundedness  control  of  uncertain  dynamic  systems,”  Automatica, 
vol.  19,  pp.  523-532,  1983. 

[19]  B.  R.  Barmish,  M.  Corless,  and  G.  Leitmann,  “A  new  class  of 
stabilizing  controllers  for  uncertain  dynamical  systems,"  SIAM  J. 
Contr.  Optimiz.,  vol.  21,  pp.  246-255.  1983. 

[20]  I.  R.  Petersen  and  B.  R.  Barmish,  "Control  effort  considerations  in  the 
stabilization  of  uncertain  dynamical  systems,"  in  Proc.  Amer.  Contr. 
Conf.,  San  Diego,  CA.  June  1984,  pp.  490-495. 


[21]  B.  R.  Barmish,  "Necessary  and  sufficient  conditions  for  quadratic 
stabilizability  of  an  uncertain  system,”  J.  Optimiz.  Theory  Appl., 
vol.  46,  pp.  399-408,  1985. 

[22]  R.  K.  Yedavalli,  S.  S.  Banda,  and  D.  B.  Ridgely,  “Time-domain 
stability  robustness  measures  for  linear  regulators,"  J.  Outdance 
Contr.  Dynam.,  vol.  8,  pp.  520-524,  1985. 

[23]  I.  R.  Petersen,  "A  Rices ti  equation  approach  to  the  design  of 
stabilizing  controllers  and  observers  for  a  class  of  uncertain  linear 
systems,’1  IEEE  Trans.  Automat.  Contr.,  vol.  AC-30,  pp.  904-907, 
1985. 

[24]  A.  R.  Galimidi  and  B.R.  Barmish,  "The  constrained  Lyapunov 
problem  and  its  application  to  robust  output  feedback  stabilization." 
IEEE  Trans.  Automat.  Contr.,  vol.  AC-31,  pp.  410-419,  1986. 

[25]  I.  R.  Petersen  and  C.  V.  Hollot,  “A  Riccati  equation  approach  to  the 
stabilization  of  uncertain  systems,”  Automatica,  vol.  22,  pp.  397- 
411,  1986. 

[26]  W.  M.  Wonham,  "Optimal  stationary  control  of  a  linear  system  with 
state-dependent  noise,”  SIAM  J.  Contr.,  vol.  5,  pp.  486-500,  1967. 

[27]  - ,  "On  a  matrix  Riccati  equation  of  stochastic  control,"  SIAM  J. 

Contr.,  vol.  6,  pp.  681-697,  1968. 

[28]  D.  Kleinman,  "Optimal  stationary  control  of  linear  systems  with 
control -dependent  noise,”  IEEE  Trans.  Automat.  Contr..  vol.  AC- 
14,  pp.  673-677,  1969. 

[29]  P.  McLane,  "Optimal  stochastic  control  of  linear  systems  with  state 
and  control -dependent  disturbances.”  IEEE  Trans.  Automat. 
Contr.,  vol.  AC-16,  pp.  793-798,  1971. 

[30]  P.  J.  McLane.  "Linear  optima)  stochastic  control  using  instantaneous 
output  feedback,”  Int.  J.  Contr.,  vol.  13,  pp.  383-396,  1971. 

[31]  U.  Haussmann,  "Optimal  stationary  control  with  state  and  control 
dependent  noise,”  SIAM  J.  Contr.,  vol.  9,  pp.  184-198,  1971. 

[32]  C.  W.  Merriam,  HI,  Automated  Design  of  Control  Systems.  New 
York:  Gordon  and  Breach,  1974. 

[33]  J.  Bismut,  "Linear-quadratic  optimal  stochastic  control  with  random 
coefficients,"  SIAM  J.  Contr.,  vol.  14,  pp.  419-444,  1976. 

[34]  G.  N.  Mil’stein,  "Design  of  stabilizing  controller  with  incomplete  state 
data  for  linear  stochastic  system  with  multiplicative  noise,”  Automat. 
Remote  Contr.,  vol.  43,  pp.  653-659,  1982. 

[35]  Y.  A.  Phillis,  "Controller  design  of  systems  with  multiplicative 
noise,”  IEEE  Trans.  Automat.  Contr.,  vol.  AC-30,  pp.  1017-1019, 
1985. 

[36]  D.  S.  Bernstein  and  D.  C.  Hyland,  “Optimal  projection/maximum 
entropy  stochastic  modelling  and  reduced-order  design  synthesis,”  in 
Proc.  IFAC  Workshop  on  Model  Error  Concepts  and  Compensa¬ 
tion,  Boston,  MA,  June  1985,  pp.  47-54. 

[37]  - ,  “The  optimal  projection/maximum  entropy  approach  to  design¬ 

ing  low-order,  robust  controllers  for  flexible  structures,”  in  Proc. 
24th  IEEE  Conf.  Decision  Contr.,  Fort  Lauderdale,  FL,  Dec.  1985, 
pp.  745-752. 

[38]  D.  S.  Bernstein,  L.  D.  Davis,  S.  W.  Greeley,  and  D.  C.  Hyland. 
"Numerical  solution  of  the  optimal  projection/maximum  entropy 
design  equations  for  low-order,  robust  controller  design,”  in  Proc. 
24th  IEEE  Conf-  Decision  Contr.,  Fort  Lauderdale,  rL.  Dec.  1985. 
pp.  1795-1798. 

[39]  D.  S.  Bernstein  and  S.  W.  Greeley,  "Robust  controller  synthesis  using 
the  maximum  entropy  design  equations,"  IEEE  Trans.  Automat. 
Contr.,  vol.  AC-31,  pp.  362-364,  1986 

[40]  D.  S.  Bernstein  and  D  C.  Hyland.  “The  optimal  projection  equations 
for  reduced-order  modelling,  estimation  and  control  of  linear  systems 
with  multiplicative  white  noise,"  J.  Optimiz.  Theory  Appl.,  1988- 

[41]  D.  C.  Hyland  and  D.  S  Bernstein,  “The  optimal  projection  equations 
for  fixed-order  dynamic  compensation,"  IEEE  Trans.  Automat. 
Contr.,  vol.  AC-29,  pp.  1034-1037,  1984. 

[42]  P.  J.  McLane,  "Asymptotic  stability  of  linear  autonomous  systems 
with  state-dependent  noise.”  IEEE  Trans.  Automat.  Contr.,  vol. 
AC-14,  pp.  754-755,  1969. 

[43]  J.  L.  Willems,  “Mean  square  stability  criteria  for  stochastic  feedback 
systems,"  Int.  J.  Syst.  Sci.,  vol.  4.  pp.  545-564,  1973. 

[44]  U.  G.  Haussmann,  "Stability  of  linear  systems  with  control  dependent 
noise,”  SIAM  J.  Contr.,  vol.  11,  pp.  382-394,  1973. 

[45]  V.  Haussmann,  "On  the  existence  of  moments  of  stationary  linear 
systems  with  multiplicative  noise.”  SIAM  J.  Contr.,  vol.  12,  pp.  99- 
105,  1974. 

[46]  J.  L.  Willems  and  J.  C.  Willems,  “Feedback  stabilizability  for 
stochastic  systems  with  state  and  control  dependent  noise,”  Auto¬ 
matica,  vol.  12,  pp.  277-283,  1976. 

[47]  J.  L.  Willems  and  J.  C.  Willems,  “Robust  stabilization  of  uncertain 
systems,"  SIAM  J.  Contr.  Optimiz.,  vol.  21,  pp.  352-374,  1983. 

[48]  L.  Arnold,  H.  Crauel,  and  V.  Wihstutz,  "Stabilization  of  linear 
systems  by  noise,"  SIAM  J.  Contr.  Optimiz.,  vol.  21.  pp.  451-461, 
1983. 

[49]  B.  D.  O.  Anderson  and  J.  B.  Moore,  Linear  Optimal  Control. 
Englewood  Cliffs,  NJ:  Prentice-Hall,  1970. 

[50]  M.  Athans,  R.  T.  Ku,  and  S.  B.  Gershwin,  "The  uncertainty  threshold 
principle:  Some  fundamental  limitations  of  optimal  decision  making 
under  dynamic  uncertainty,”  IEEE  Trans.  Automat.  Contr.,  vol 
AC-22,  pp.  491-495,  1977. 

[51]  R.  T.  Ku  and  M.  Athans,  "Further  results  on  the  uncertainty  threshold 


1084 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL.  VOL.  AC-32.  NO.  12,  DECEMBER  19*7 


grmciple,”  IEEE  Trans.  Automat.  Contr.,  vol.  AC-22,  pp.  866- 

[52]  D.  S.  Bernstein  and  D.  C.  Hyland,  “Optimal  projection  for  uncertain 
systems  (OPUS):  A  unified  theory  of  reduced-order,  robust  control 
design,"  in  Large  Space  Structures:  Dynamics  and  Control,  S.  N. 
Atluri  and  A.  K.  Amos,  Eds,  New  York:  Springer-Verlag,  1987. 

[53]  D.  C.  Hyland  and  D.  S.  Bernstein,  “The  majorant  Lyapunov  equation: 
A  nonnegative  matrix  equation  for  guaranteed  robust  stability  and 
performance  of  large  scale  systems,"  Amer.  Contr.  Conf.,  Minneap¬ 
olis,  MN,  June  1987,  pp.  910-917;  also  in  IEEE  Trans.  Automat. 
Contr.,  vol.  AC-32,  pp.  1005-1013,  Nov.  1987. 

154]  D.  S.  Bernstein  and  W.  M.  Haddad,  “The  optimal  projection  equations 
with  Petersen-Hollot  bounds:  Robust  controller  synthesis  with  guaran¬ 
teed  structured  stability  radius.”  IEEE  Conf.  Decision  Contr.,  Los 
Angeles,  CA,  Dec.  1987. 

[55]  W.  M.  Haddad,  "Robust  optimal  projection  control-system  synthesis,” 
Ph.D.  dissertation,  Dep.  Mechanical  Eng.,  Florida  Inst.  Technol., 
Melbourne.  FL.  Mar.  1987 

[56]  J.  W.  Brewer,  "Kronecker  products  and  matrix  calculus  in  system 

theory,"  IEEE  Trans.  Circuits  Syst.,  vol.  CAS-25,  pp.  772-781, 
1978.  . 


[57]  L.  Arnold,  Stochastic  Differential  Equations:  Theory  and  Applica¬ 
tions.  New  York:  Wiley,  1974. 

[58]  I.  Medanic,  "On  stabilization  and  optimization  by  output  feedback,"  in 
Proc.  Twelfth  Asilomar  Conf ■  Circ.,  Syst.  Comp.,  1978,  pp.  412- 
416. 

[59]  S.  Renjen  and  D.  P.  Looze,  “Synthesis  of  decentralized  output/state 
regulators,"  in  Proc.  Amer.  Contr.  Conf-,  Arlington,  VA,  June 
1982,  ro.  758-762. 

[60]  D.  S.  Bernstein,  "The  optimal  projection  equations  for  static  and 
dynamic  output  feedback:  The  singular  case,’1  this  issue,  pp.  1139- 
1143. 

[61]  C.  R.  Rao  and  S.  K.  Mitra,  Generalized  Inverse  of  Matrices  and  Its 
Applications.  New  York:  Wiley,  1971. 

[62]  W.  M.  Wortham,  Linear  Multivariable  Control:  A  Geometric 
Approach.  New  York:  Springer-Verlag,  1979. 


Dennis  S.  Bernstein  (M'82),  for  a  photograph  and  biography,  see  p.  1013  of 
the  November  1987  issue  of  this  TRANSACTIONS. 


APPENDIX  G:  Robust  Analysis 


D.  S.  Bernstein  and  W.  M.  Haddad,  "Robust  Stability  and  Performance 
Analysis  for  T linear  Dynamic  Systems,"  TEEF.  Trans.  Autom.  carrtr. .  Vol. 
34,  1989,  to  appear. 

D.  S.  Bernstein  and  W.  M.  Haddad,  "Robust  Stability  and  Performance 
Analysis  for  State  Space  Systems  via  Quadratic  Iyapunov  Bounds," 
submitted  to  SIAM  J,  Matrix  Anal.  Applt 

D.  C.  Hyland  and  D.  S.  Bernstein,  "The  Majorant  Lyapunov  Equation: 

A  Nannegative  Matrix  Equation  for  Guaranteed  Robust  stability  and 
Performance  of  Large  Scale  Systems,"  tree  Trans.  Autom.  Qomtr. . 

Vol.  AC-32,  pp.  1005-1013,  1987. 


October  1987 
Revised  May  1988 


Robust  Stability  and  Performance  Analysis 

for 

Linear  Dynamic  Systems 


by 


Dennis  S.  Bernstein 
Harris  Corporation 

Government  Aerospace  Systems  Division 
MS  22/4848 
Melbourne,  FL  32902 


Wassim  M.  Haddad 
Department  of  Mechanical  and 
Aerospace  Engineering 
Florida  Institute  of  Technology 
Melbourne,  FL  32901 


Abstract 

In  a  recent  paper  Zhou  and  Khargonekar  obtained  sufficient  conditions  for  robust  stability  over 
specified  sets  of  matrix  perturbations.  In  the  present  paper  these  results  are  extended  to  include, 
in  addition,  performance  bounds.  Here  performance  is  defined  as  the  worst-case  expected  value  of 
a  quadratic  functional  involving  the  state  variables  when  the  system  is  subjected  to  white  noise 
disturbances.  The  results  are  illustrated  by  considering  the  gain  margin  of  both  an  LQG  controller 
and  a  robustified  design  obtained  by  Bernstein  and  Greeley  for  Doyle’s  example. 
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1.  Introduction 


It  is  well  known  that  unavoidable  discrepancies  between  mathematical  models  and  real-world 
systems  can  result  in  the  degradation  of  control-system  performance.  Ideally,  feedback  control 
systems  should  be  designed  to  be  robust  with  respect  to  uncertainties  in  the  plant  characteristics. 
Thus  robustness  analysis  must  play  a  key  role  in  control-system  design.  That  is,  given  an  existing 
or  proposed  control  system,  determine  the  performance  degradation  due  to  variations  in  the  plant. 
The  most  fundamental  concern  in  this  regard  is  clearly  that  of  stability.  For  linear  state  space 
systems  with  which  the  present  paper  is  concerned,  this  problem  has  received  increasing  attention 
over  the  past  several  years  (see,  e.g.,  [1-12]). 

One  of  the  principal  techniques  used  to  assess  robust  stability  is  based  upon  quadratic  Lyapunov 
functions  (see  [1-4,10]).  Quadratic  Lyapunov  functions  have  also  been  used  extensively  for  robust 
control-system  synthesis ;  see  [13]  for  relevant  references.  The  problem  of  robust  synthesis  ia, 
however,  beyond  the  scope  of  the  present  paper. 

In  addition  to  assessing  robust  stability,  it  is  often  desirable  to  quantify  performance  by  consid¬ 
ering  the  degradation  of  a  cost  functional  as  the  plant  parameters  deviate  from  their  nominal  values. 
Although  any  robustly  stable  system  over  a  compact  set  of  parameters  possesses  a  worst-case  per¬ 
formance,  it  is  desirable  in  practice  to  actually  determine  a  bound  for  the  worst-case  performance. 
The  concern  for  both  robust  stability  and  performance  goes  back  to  the  early  work  of  Michael 
and  Merriam  [14],  while  more  recent  references  include  the  work  of  Chang  and  Peng  [15],  Noldus 
[16],  and  Petersen  [17].  The  results  of  [15-17]  can  be  shown  to  depend  upon  a  modified  Lyapunov 
equation  of  the  form 

0  =  AQ  +  QAT  +  n{Q)+V,  (1.1) 

where  the  operator  Cl(Q)  is  chosen  to  bound  terms  of  the  form  AAQ  +  QAAT ,  where  AA  is 
an  uncertain  perturbation  of  the  dynamics  matrix  A.  Since  robust  performance  per  se  was  not 
discussed  in  [16,17],  the  work  most  closely  related  to  the  present  paper  is  that  of  Chang  and  Peng 
[15].  They  essentially  show  that  consideration  of  (1.1)  leads  to  a  bound  on  worst-case  performance. 
Although  the  development  in  [15]  was  carried  out  for  full-state  feedback,  specialization  of  their 
approach  to  robust  performance  analysis  is  straightforward.  A  systematic,  in-depth  treatment  of 
robust  performance  analysis  involving  the  approach  of  [15]  as  well  as  other  bounds  is  given  in  [18]. 

The  starting  point  for  the  present  paper  is  the  recent  paper  by  Zhou  and  Khargonekar  [10].  By 
analyzing  the  Lyapunov  equation  they  obtain  a  series  of  stability  robustness  tests  which  improve 
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significantly  upon  earlier  work  [2-4],  In  the  present  paper  we  extend  the  results  of  [10]  to  obtain, 
in  addition,  a  bound  on  worst-case  performance.  As  in  (1.1)  we  consider  a  Lyapunov  equation  of 
the  form 

0  =  AQ  +  QAT  +  C1  +  V,  (1.2) 

where  f 1  bounds  uncertainty  terms  of  the  form  A AQ  +  QAAT.  The  principal  difference  between 
(1.1)  and  (1.2)  is  that  Cl  in  (1.2)  is  a  constant  matrix  independent  of  the  solution  Q.  The  case 
considered  in  [15]  in  which  ft  is  a  function  of  Q  is  discussed  in  [18]. 

The  cost  functional  used  in  the  present  paper  to  quantify  robust  performance  is  the  trace  of  the 
output  covariance  of  a  system  subjected  to  white  noise  disturbances.  This  measure  of  performance 
is  identical  in  form  to  the  standard  performance  criterion  of  LQG  theory.  Since  we  also  obtain 
a  bound  for  the  state  covariance  matrix,  our  results  yield  bounds  on  the  variances  (mean  square 
response  levels)  of  system  states.  Although  the  results  of  [15]  were  obtained  within  a  deterministic 
setting,  it  is  easy  to  see  that  the  performance  criterion  of  [15]  is  also  of  this  form. 

The  contents  of  the  paper  are  as  follows.  After  introducing  notation  at  the  end  of  this  section 
we  consider  the  robust  stability  and  performance  problems  in  Section  2.  In  Section  3  we  present 
the  main  result  (Theorem  3.1)  which  provides  sufficient  conditions  for  robust  stability  over  a  set 
of  parameter  variations  along  with  a  performance  bound.  In  Section  4  we  present  a  dual  result 
(Theorem  4.1)  in  terms  of  the  dual  matrix  P.  This  result  serves  two  purposes.  First,  it  clarifies 
connections  with  the  previous  literature  where  results  are  presented  in  terms  of  the  quadratic 
Lyapunov  function  V (x)  =  x TPx.  And,  second,  we  show  that  the  dual  performance  bound  may 
be  much  better  than  the  primal  bound  (and  vice  versa)  for  particular  problems.  The  results  of 
Theorems  3.1  and  4.1  are  given  in  terms  of  a  robustness  set  U  which  is  a  subset  of  a  maximal 
set  U.  Since  U  is  defined  implicitly,  we  provide  explicit  characterizations  of  subsets  U  in  Section 
5.  Here  we  restate  the  principal  results  of  [2-4,10]  which,  in  our  context,  correspond  to  particular 
characterizations  of  subsets  of  U.  We  also  introduce  an  additional  subset  of  U  which  provides  a  new 
robust  stability  result.  Finally,  in  Section  6  we  consider  a  pair  of  illustrative  examples.  The  first 
example,  which  was  previously  considered  in  [10],  involves  two  uncertain  parameters.  It  is  shown 
that  the  new  guaranteed  stability  region  is  considerably  larger  for  certain  parameter  values  than  the 
regions  given  in  [10]  (see  Figure  1).  Furthermore,  we  obtain  a  robust  performance  bound,  a  result 
which  has  no  counterpart  in  [10].  The  second  example  involves  controllers  for  a  second-order  open- 
loop  unstable  plant  originally  considered  in  [19]  to  demonstrate  the  lack  of  a  guaranteed  stability 
margin  for  LQG  controllers.  We  apply  Theorems  3.1  and  4.1  to  analyze  both  the  LQG  design  and 


a  robustified  design  obtained  in  [20].  We  show  that  the  new  robust  stability  test  is  effective  in  the 
sense  that  the  guaranteed  gain  margin  for  the  robustified  controller  is  a  factor  of  5  larger  than  the 
actual  gain  margin  of  the  LQG  design. 

Notation 

Note:  All  matrices  have  real  entries 

IR,  IRrX*,lRr,lE  real  numbers,  r  x  «  real  matrices,  IRrXl,  expectation 

Ir  r  x  r  identity  matrix 

asymptotically  stable  matrix  matrix  with  eigenvalues  in  open  left  half  plane 

Sr,  IN',  IPr  r  x  r  symmetric,  nonnegative-definite,  positive-definite  matrices 

Z\  >  Z^t  Z\  >  Zt  Z\  —  Z%  S  IN',  Zx  —  Zt  G  IPr,  Z\ ,  Zx  G  Sr 

tr  Z,ZT,  co  trace  of  Z,  tranpose  of  Z,  convex  hull 

^mia(Z),  A m%x(Z)  smallest  and  largest  eigenvalues  of  Z  G  Sr 


\\Z\\. 

spectral  norm 

Z(iJ) 

(i,  jf)  element  of  matrix  Z 

Z>>  0 

Z[*,j)  si  0,  i,  j  =  1, . . . ,  r, 

Z  G  JRrxr 

Z»  0 

Z  G  JRrxr 

Wm 

{|%»l Z  e  IR'” 

(matrix  modulus) 

2.  Robust  Stability  and  Performance  Problems 

Let  U  C  IRnxn  denote  a  set  of  perturbations  A  A  of  the  nominal  dynamics  matrix  A.  Through¬ 
out  the  paper  it  is  assumed  that  A  is  asymptotically  stable.  We  begin  by  considering  the  question 
of  whether  or  not  A  +  A  A  is  asymptotically  stable  for  all  A  A  G  U. 

Robust  Stability  Problem.  Determine  whether  the  linear  system 

*(t)  =  (A  +  AA)*(t),  t  G  [0,oo),  (2.1) 

is  asymptotically  stable  for  all  A  A  G  U. 

The  problem  of  robust  performance  involves  a  quadratic  form  xT(t)Rx(t),  where  R  G  INn, 
when  the  system  is  subjected  to  a  white  noise  disturbance  w(t)  with  nonnegative-definite  intensity 
V .  The  matrix  R  can  be  viewed  as  a  means  for  selecting  output  variables  of  interest  while  the 
matrix  V  can  be  used  to  specify  disturbance  levels. 


Robust  Performance  Problem.  For  the  disturbed  linear  system 

i(t)  =  (A  +  AA)x(t)  +  w(t),  t  e  [0,  oo),  (2.2) 

determine  a  performance  bound  0  satisfying 

J(U)=  sup  limsuplE [xT{t)Rx[t)\<  0.  (2.3) 

AA£U  t— *oo 

The  system  (2.2)  may,  for  example,  denote  a  control  system  in  closed-loop  configuration  sub¬ 
jected  to  external  white  noise  disturbances  (see  Section  6).  Such  specializations  are  not  required 
for  this  development,  however.  Note  that  J{U)  represents  the  worst  case  (over  U)  of  the  average 
(over  the  white  noise  statistics)  of  quadratically  weighted  steady-state  deviations  of  the  state  from 
the  origin.  Thus  0  represents  an  upper  bound  on  selected  output  variances. 

Of  course,  since  R  and  V  are  only  assumed  to  be  nonnegative  definite,  there  may  be  cases  in 
which  a  finite  performance  bound  0  satisfying  (2.3)  exists  while  (2.1)  is  not  asymptotically  stable 
over  U.  In  practice,  however,  robust  performance  is  mainly  of  interest  when  (2.1)  is  robustly  stable. 
In  this  case  the  performance  J(U)  is  given  in  terms  of  the  steady-state  second  moment  of  the  state. 
The  following  result  from  linear  system  theory  will  be  useful. 

Lemma  2.1.  Suppose  (2.1)  is  asymptotically  stable  for  all  A  A  €  U.  Then 

J{U)=  sup  tr  Q&aR,  (2.4) 

AAgU 

where  n  x  n  Qaa  —  limt_.oo  D3[*(t)xr(t)]  is  the  unique,  nonnegative-definite  solution  to 

0  =  (A  -I-  AA)Q aa  +  <2 a.4  (A  +  A  A)r  +  V.  (2.5) 

In  the  present  paper  our  approach  is  to  obtain  sufficient  conditions  for  robust  stability  as  a 
consequence  of  sufficient  conditions  for  robust  performance.  Such  conditions  are  developed  in  the 
following  sections. 

3.  Sufficient  Conditions  for  Robust  Stability  and  Performance 

The  key  step  in  obtaining  robust  stability  and  performance  is  to  replace  the  uncertain  terms  in 
the  Lyapunov  equation  (2.5)  by  a  bounding  matrix  0.  The  nonnegative-definite  solution  Q  of  this 
bounding  Lyapunov  equation  is  then  guaranteed  to  be  an  upper  bound  for  Q&a-  The  uncertainty 
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set  U  over  which  robustness  is  guaranteed  then  depends  upon  Q.  The  following  easily  proved  result 
is  fundamental  and  forms  the  basis  for  all  later  developments.  The  hypotheses  of  this  result  are  of 
a  general  nature  and  are  not  intended  to  be  directly  verifiable.  Suitably  verifiable  specializations 
of  the  hypotheses  are  discussed  in  Section  5. 

Theorem  3.1.  Let  fl  €  INn,  let  Q  €  INn  be  the  unique  solution  to 

0  =  AQ  +  QAT  +  (1  +  V,  (3.1) 


and  let  U  be  a  subset  of 


U  =  {AA  6  HtnXn  :  AAQ  +  QAAr  <  Cl}.  (3.2) 

Then 

(A  +  AA,  [V  +  fl  -  ( AAQ  +  <?AAr)]  * )  is  stabilizable,  A  A  ell,  (3.3) 

if  and  only  if 

A  +  A  A  is  asymptotically  stable,  A  A  €  U.  (3.4) 

In  this  case, 

Qaa  <  Q,  &AeU,  (3.5) 

where  Q&a  €  INn  is  given  by  (2.5),  and 

J{U)  <  tr  QR.  (3.6) 

If,  in  addition,  there  exists  A  A  €  U  such  that  (A+ AA,  [V  +  fl  —  (AAQ  +  QAA1*)^)  is  controllable, 
then  Q  is  positive  definite. 

Proof.  This  result  is  a  minor  variation  of  Theorem  3.1  of  [21]  and  hence  the  proof  is 
omitted.  □ 

To  apply  Theorem  3.1,  one  first  chooses  a  nonnegative-definite  matrix  fl  and  then  solves  (3.1) 
for  Q.  Next,  as  shown  in  Section  4,  one  examines  U  to  determine  subsets  U  of  perturbations 
A  A  over  which  robustness  is  guaranteed.  Note  that  if  U\  and  Ui  are  subsets  of  U  then  so  is  the 
convex  hull  of  their  union.  (To  see  this  note  that  U  is  convex.)  The  set  U  is  the  largest  set  over 
which  robustness  can  be  guaranteed  by  Theorem  3.1  for  the  particular  choice  of  fl.  One  may  also 
select  several  matrices  Q  and  determine  subsets  of  each  resulting  U  as  a  constructive  approach  to 
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determining  larger  robustness  sets.  In  the  next  section  we  examine  subsets  U  of  U  of  specified 
structure.  Before  doing  so,  we  have  the  following  observations. 

In  applying  Theorem  3.1  it  may  be  convenient  to  replace  condition  (3.3)  with  stronger  condi¬ 
tions  which  are  easier  to  verify  in  practice.  The  following  result  is  immediate. 

Proposition  3.1.  Consider  the  conditions 


V  >  0, 

(3.7) 

(A  +  A  A,  V»)  is  stabilizable,  A  A  6  U, 

(3.8) 

AAQ  +  QAAT<nt  AAeU , 

(3.9) 

AAQ  +  qaat  <  n  +  V,  AAeU. 

(3.10) 

Then  (3.7)  =►  (3.8)  =>  (3.3),  (3.7)  =>  (3.10)  =>  (3.3),  and  (3.9)  =»  (3.10)  =>  (3.3). 

If  only  robust  stability  is  of  interest,  then  the  noise  intensity  V  need  not  have  physical  sig¬ 
nificance.  In  this  cse  one  may  either  set  V  =  eln,  where  e  >  0  is  small  to  satisfy  (3.7),  or  set 

V  —  0  and  confine  U  to  perturbations  A  A  for  which  (3.9)  holds.  This  is  the  case  in  [3,4,10]  where 

V  —  0,fl  =  2 In,  and  the  parametric  robustness  sets  are  characterized  by  strict  inequality. 

Remark  3.1.  Since  A  is  asymptotically  stable,  Q  is  given  by 

pQQ  r  oo 

Q=  /  cAt(n  +  V)eATtdt=  eAiQeATtdt  +  Q0,  (3.11) 

Jo  Jo 

where  Qq  €  IN'*  is  given  by 

0  =  AQo  +  QoAt-I-V.  (3.12) 

Note  that  Q0  <  Q  and  that  the  nominal  performance  is  given  by  tr  Q 0R. 

Remark  3.2.  Using  (3.11)  it  is  also  useful  to  note  that  the  bound  for  J{U)  given  by  (3.6)  cam 
be  written  as 

tr  QR=  tr  f  eAt(C i  +  V)eATtdtR=  trP0(n  +  ^),  (3.13) 

Jo 

where  Po  €  INn  is  given  by 

0  =  AtPq  +  P0A  +  R.  (3.14) 

The  bound  tr  Po(H  +  V)  can  be  viewed  as  a  dual  formulation  of  the  bound  tr  QR  since  the 
roles  of  A  and  AT  are  reversed.  Dual  bounds  are  developed  in  the  following  section.  Note  that 
tr  QoR  =  tr  PqV. 


6 


4.  Dual  Sufficient  Conditions  for  Robust  Stability  and  Performance 

As  noted  in  Remark  3.2,  the  performance  bound  tr  QR  given  by  (3.6)  can  be  expressed  equiv¬ 
alently  in  terms  of  a  dual  variable  Po  for  which  the  roles  of  A  and  AT  are  reversed.  Using  a  similar 
technique,  additional  conditions  for  robust  stability  and  performance  can  be  obtained  by  developing 
a  dual  version  of  Theorem  3.1.  A  prime  motivation  for  developing  such  dual  bounds  is  to  draw 
direct  connections  with  previous  results  in  the  literature  relating  to  robust  stability.  Traditionally, 
the  use  of  the  quadratic  Lyapunov  function  V(x)  =  xTPx  for  robust  stability  leads  naturally  to  the 
dual  formulation.  In  addition,  the  dual  bounds  may,  for  certain  problems,  be  much  sharper  than 
the  bounds  introduced  in  the  previous  section.  This  point  is  illustrated  at  the  end  of  this  section  by 
examining  an  extreme  case  and  in  Section  6  by  means  of  numerical  examples.  We  note,  in  addition, 
that  robust  performance  bounds  are  more  difficult  to  motivate  within  the  dual  formulation  without 
first  developing  the  primal  results.  The  following  result  is  immediate. 

Lemma  4.1.  Suppose  (2.1)  is  asymptotically  stable  for  all  A  A  €  U.  Then 

J{U)  =  sup  1 t  PAAV,  (4.1) 

AAGU 

where  n  x  n  PAA  is  the  unique,  nonnegative-definite  solution  to 

0  =  (A  +  A  A)tPaa  +  Paa(A  +  A  A)  +  R.  (4.2) 

The  dual  of  Theorem  3.1  can  now  be  stated. 

Theorem  4.1.  Let  A  €  IN”,  let  P  €  IN”  be  the  unique  solution  to 

0  =  AtP  +  PA  +  A  +  R,  (4.3) 


and  let  U  be  a  subset  of 


U'  =  {A  A  €  IR”X"  :  A  AtP  +  PA  A  <  A}. 


Then 


^  [R  +  A  -  (A  AFP  +  PA  A)]  ^ ,  A  +  A  A)  is  detectable,  A  A  €  U , 


if  and  only  if 


A  +  A  A  is  asymptotically  stable,  A  A  €  U. 


(4.4) 

(4.5) 

(4.6) 
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In  this  case, 

Paa  <  P,  A A€U,  (4.7) 

where  Pa  a  €  IN"  is  given  by  (4.2),  and 

J(U)  <  tr  PV.  (4.8) 

If,  in  addition,  there  exists  A  A  €  U  such  that  ([R  +  A  -  (A  ATP  +  PAA)]$ ,  A  +  AA)  is  observable, 
then  P  is  positive  definite. 

The  usefulness  of  Theorem  4.1  resides  in  the  fact  that  it  provides  stability  and  performance 
bounds  which  are  generally  different  from  those  given  by  Theorem  3.1.  Hence,  depending  upon  ft 
and  A  either  bound  (3.6)  or  bound  (4.8)  may  be  better  for  a  particular  problem.  To  illustrate  how 
dual  bounds  can  improve  estimates  of  robust  performance,  consider  the  case  in  which  V  =  0,  i.e., 
plant  disturbances  are  absent.  In  this  case  Q&a  =  0  satisfies  (2.5)  and  thus  J(U)  =  0  so  long  as 
A  +  AA  is  stable  for  all  AA  €  U.  The  performance  bound  tr  QR  given  by  (3.6)  may,  however, 
be  arbitrarily  large  depending  upon  R  since  Q  may  be  nonzero  due  to  ft.  Hence  this  performance 
bound  may  be  arbitrarily  conservative.  The  dual  bound  (4.8),  on  the  other  hand,  is  zero  in  this 
case,  which  completely  eliminates  the  conservatism. 

5.  Characterization  of  Subsets  of  U  and  U' 

To  apply  Theorems  3.1  and  4.1  it  is  necessary  to  explicitly  characterize  subsets  U  of  U  and  U' 
over  which  robustness  is  guaranteed.  In  this  section  we  provide  several  such  characterizations  by 
collecting  together  and  extending  known  results  from  the  literature. 

For  the  following  result  let  ft  =  «/„,  where  w  >  0,  let  W  €  IR"xn,  W  »  0,  and  let 
Als . . . ,  Ap  €  IR'*Xn  be  arbitrary.  Furthermore,  for  Q  €  IP"  satisfying  (3.1)  define  for  f  =  1, . . . , p: 

=  A mia(AiQ  +  QAf ),  Pi  ±  \m„(AiQ  +  QAj), 

Ii  =  (-00,  oo),  (*i  =  Pi  =  0, 

=  (-oo ,w/Pi),  <*»•  >  o ,  Pi  >  0, 

=  (w/o^,oo),  oti  <  0,  Pi  <  0, 

=  ( u/cti,u/Pi),  ai<0<pi. 

Finally,  let  e^  denote  the  ith  column  of  the  pxp  identity  matrix. 
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Proposition  5.1.  Let  Q  €  IPn  satisfy  (3.1)  with  Cl  =  uln,  where  w  >  0.  Then  the  following 
sets  are  subsets  of  U  which  also  satisfy  (3.9): 

Hi  A  {AA  ||AA||.  <  flfell:1}, 

Ui  =  {A A  €  nrxn  :  \AA\m  «  u\\W\Q\n  +  \Q\mWT\\;1W} , 

Us  =  {AA€lRn*n:  A  A  =  £criAi,  - . .  ,*p)r  €  £}, 

i=i 

where  £  is  one  of  the  following  regions  in  IRP: 

=  {(^x,  -  -  -  ,^-p) :  +  <  <*>}, 

t=i 

Z.t  =  {(aru...,ap):  £*?  <  w*||  £(AQ  +  QAf)2^1}, 

i=i  »=i 

*s  =  {ki,...,<rP) :  Wi\  <w||  +  i  =  l,...,p}, 

i=i 

£4  =  cofoej*0  :  a*  €  J«,  *  =  1, . . .  ,p>. 

For  the  dual  case  we  set  A  =  A In,  where  A  >  0,  and  define  the  dual  sets 
#2,  £3,  and  £4  in  an  analogous  fashion. 

Remark  5.1.  The  proof  of  Proposition  5.1  is  omitted  since  the  results  are  either  known  or 
are  immediate.  Specifically,  U[  can  be  found  in  [2]  while  U'3  appears  in  [3,4].  The  sets  £'1,  £'2, 
and  £3  are  given  in  [10].  The  set  £4  has  not  appeared  previously  in  the  literature  although  the 
result  is  immediate.  It  is  only  necessary  to  diagonalize  Af  P  +  PA+  by  means  of  an  orthogonal 
transformation  and  compare  diagonal  elements  to  obtain  I-.  Taking  the  convex  hull  over  the 
intervals  1/  thus  yields  £4.  Of  course,  the  required  eigenproblem  entails  additional  computation. 

Remark  5.2.  Although  most  of  the  dual  of  Proposition  5.1  has  appeared  previously,  the 
primal  result  Proposition  5.1  has  not  been  discussed  in  the  literature.  For  robust  stability  this 
result  can  be  obtained  by  considering  the  stability  of  AT  in  place  of  A.  As  will  be  shown  in  Section 
6,  the  primal  and  dual  results  lead  in  general  to  different  robust  stability  regions  and  performance 
bounds.  It  should  also  be  stressed  that  although  most  of  the  dual  of  Proposition  5.1  has  appeared 
previously,  the  present  paper  extends  its  applicability  to  the  problem  of  robust  performance  in 
addition  to  robust  stability. 

Remark  5.3.  As  mentioned  previously,  the  convex  hull  of  the  union  of  any  collection  of  subsets 
of  U  is  also  a  subset  of  U  since  U  is  convex.  This  observation  applies  to  U3  in  the  sense  that  if  ll3  is 
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a  subset  of  U  with  regions  Z  —  k  and  £  =  k  separately,  then  ft  3  is  also  a  subset"  with  Z  equal  to 
the  convex  hull  of  the  union  of  £  and  k.  Note  that  these  observations  follow  from  the  convexity 
of  U  and  do  not  contradict  the  fact  that  the  set  of  asymptotically  stable  matrices  is  not  convex. 

Remark  5.4.  The  requirement  that  ft  be  of  the  form  uln  is  not  a  constraint  in  applying 
Proposition  5.1.  Indeed,  it  is  only  required  that  ft  be  positive  definite.  To  see  this  let  invertible  <f>  € 
Htnxn  be  such  that  4>Cl<f>T  =  In.  Then  Proposition  5.1  cm  be  applied  with  suitable  transformations 
of  AA,Q,W,  and  A ». 

Remark  5.5.  As  in  [2-4,10],  the  sets  Zii,&3,£i,£3,  and  £3  are  defined  in  terms  of  strict 
inequalities.  In  this  case  Ui,Us,  and  Us  consist  of  elements  of  U  satisfying  A AQ  +  QAAT  <  ft  so 
that  (3.9)  is  satisfied.  Thus,  by  Proposition  3.1,  the  stabilisability  condition  (3.3)  is  automatically 
satisfied  without  reference  to  V. 

Remark  5.6.  In  the  special  case  p  =  1  it  is  clear  that  Zi  =  £3.  Furthermore,  in  this  case 
£$  is  always  a  subset  of  £1  and  £3  and  hence  leads  to  a  more  conservative  stability  region.  The 
largest  possible  set  of  perturbations  A  A  of  the  form  contained  in  U  is  given  by  £4. 

Remark  5.7.  It  is  shown  in  Remark  2.12  of  [10]  that  Uj  can  be  obtained  as  a  consequence  of 
Us  with  £  =  £3  and  a  suitable  choice  of  A».  Hence  Us  need  not  actually  be  considered  separately. 
Our  assumption  that  W  »  0  (and  not  W  >>  0)  is  for  convenience  only. 

Remark  5.8.  Note  that  all  of  the  subsets  of  U  given  by  Proposition  5.1  are  symmetric  except 

for  Us  with  £  =  £4.  When  the  actual  stability  region  is  highly  asymmetric,  it  follows  that  a 

» 

symmetric  robust  stability  region  is  necessarily  highly  conservative.  This  observation  is  illustrated 
by  an  example  in  Section  6. 

Remark  5.9.  The  regions  given  by  £i,£3,  and  £3  correspond,  respectively,  to  1-norm,  2- 
norm,  and  oo-norm  neighborhoods.  These  results  can  easily  be  extended  to  include  more  general 
regions.  For  example,  in  the  definition  of  £3  replace  <rt  by  c u/ai  and  A'iQ+QA?  by  ^(AiQ+QAj), 
where  is  an  arbitrary  positive  constant,  t  =  1  With  this  modification  £3  corresponds  to 

an  elliptical  robust  stability  region.  Detailed  investigation  of  such  regions  is  beyond  the  scope  of 
this  paper. 

Remark  5.10.  When  each  interval  7*  is  finite,  or  when  only  a  finite  interval  is  of  interest, 
£4  can  be  expressed  as  the  convex  hull  of  a  finite  number  of  points.  Specifically,  letting  7,  = 
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(a«,  &*],  »  =  ,p,  it  follows  that 


£4=  cofais^.fcte^,. 


a  efc)  h 
aPep  »  °P 


This  set  is  illustrated  by  means  of  an  example  in  the  next  section. 
6.  Examples 


As  a  first  example  we  adopt  Example  2  of  [10].  This  example,  which  involves  two  uncertain 
parameters,  was  used  in  [10]  to  illustrate  the  robust  stability  regions  £3,  and  £,.  The  problem 
was  originally  cast  in  the  form  of  a  static  output  feedback  controller  with  uncertain  gains.  Here  for 
convenience  in  discussing  robust  performance  we  reformulate  the  example  to  involve  uncertainty  in 
the  control  input  matrix.  Hence  consider  the  control  system 


±(t)  =  Ao*(t)  +  Bo«(0> 
v(0  =  Co  x{t), 

«(*)  =  *y(*). 

where 


'-1  0  0‘ 

1  1 

’l  o‘ 

Ao  = 

0-2  0 
0  0-3 

II 

0? 

0  1 

1  1 

J 

,  Co  = 

10  1 
0  1  0 

,  K  = 

-1  0 

0  -1 

and  the  uncertainty  ABq  in  Bo  is  given  by 


(6.1) 

(6.2) 

(6.3) 


AB0 


—<Ti  0 
0  —<Ti 

—<Ti  —O' 3 


The  closed-loop  dynamics  matrix  is  then  given  by 


A  +  AA  = 


-2  +  ffi  '  0 

0  — 3  + 

—  1  +  <T\  —1  +  a 3 


-1  +  <ri 
0 

—4  +  <T\ 


where  A  A  =  <riAi  +  ^j  Aj  and  Aj,  Aj  have  the  evident  definitions.  It  can  easily  be  shown  that  the 
exact  stability  region  is  given  by  o\  €  (-00, 1.75)  and  o-3  €  (-00, 3).  Thus  the  nominal  dynamics 
matrix  corresponding  to  o\  —  <?}  =  0  lies  in  the  upper  right-hand  corner  of  the  exact  stability  region 
so  that,  as  noted  in  Remark  5.8,  a  high  degree  of  conservatism  can  be  expected  using  symmetric 
robustness  regions.  To  consider  robust  stability  alone,  set  V  =  R  =  0  and  u  =  A  =  2.  In  this  case 
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regions  Z\,  Z2,  and  Z'Sy  as  computed  in  [10],  are  shown  in  Figure  1.  Region  Z\  for  this  problem  is 
given  (see  Remark  5.10)  by 

Co65)-  U,).  (,°85)}. 

which  accounts  somewhat  better  for  the  asymmetry  of  the  stability  region.  The  regions  Zi,  Z2, 
and  je,  were  found  to  be  smaller  than  the  corresponding  dual  regions,  while  £4  is  given  by 

(t)>  (-X0,)-  (2.63)}’ 

which  yields  slight  improvement  in  <7i- 

To  evaluate  robust  performance  replace  (6.1)  by 

i(t)  =  Aox(t)  +  B0u(t)  +  w(t),  (6.4) 


and  define 

J  =  Urn  IE  [*r(t)R1*(t)  +  uT(t)R2u(t)] , 

which  corresponds  to  (2.3)  with  R  =  Ri  +  Cj KtR2KCq.  Hence  setting  Ri  =  I3  and  JS2  =  I2 
yields 

’2  0  1‘ 

R=  0  2  0  . 

1  0  2 

We  also  set  V  =  I3  and  w  =  A  =  2.  The  resulting  stability  region  for  these  values  of  V  and  R  is 
given  by 

=  {(°i>M  :  M/-70+  |<ra|/1.46  <  l}, 

*a  =  {(*1,**)  ■  +«r|  <  (.70)*}, 

*3=  {MM :  kil  <  -68,  *  =  1>2}, 

*•■"(('?*)■  (■").  U). 

Over  these  combined  regions  the  performance  bound  was  computed  to  be  tr  PV  =  2.26.  The 
primal  result  produced  the  regions 

*1  =  {MM  :  M/1.09  +  M/1.75  <  1} , 

£a  =  {MM  :  *1  +o\  <  (108)*}  , 

Zs  =  (MM  ••  M  <  10>  «  =  1»2> , 

(T).  (-"»)•  (,yi- 


Over  these  regions  the  performance  bound  was  computed  to  be  tr  QR  =  3.18.  Contour  plots  of 
actual  performance  for  perturbed  values  of  o\  and  arj  are  shown  in  Figure  2.  Note  that  when  deter¬ 
mining  robust  performance  Theorems  3.1  and  4.1  yield  performance  bounds  over  robust  stability 
regions  which  are  generally  smaller  than  the  robust  stability  regions  determined  with  R  =  0  and 
V  =  0.  This  mechanism  represents  the  natural  tradeoff  between  stability  and  performance.  In 
general,  to  determine  the  largest  stability  regions,  V  and  R  should  be  set  to  zero  initially. 

As  a  second  example  we  consider  the  control  system  given  in  [19]  to  demonstrate  the  lack  of 
guaranteed  gain  margin  for  LQG  controllers.  Hence  consider 


with  controller 


and  performance 


The  data  are 


*o  (t)  =  Aox0  (t)  +  B0u(t)  +  wi(t), 
y(t)  =  C0*o(0  +  wa(t), 


*«(t)  =  A,xe{t)  +  Bey(t), 
u(t)  =  Cexe(t), 

J  =  ^lim^  IE  [iq  (t)Biio(O  +  ur(t)Bju(t)] 


(6.5) 

(6.6) 


(6.7) 

(6.8) 

(6.9) 


Ao  = 


1  1 
0  1 


Vi  =  Ri=p 


Bn  = 


1  l' 

1  ’ 


,  Cq  —  [\  0], 
V,  =  R,  =  1, 


where  and  Vj  are  the  intensities  of  wx(t)  and  tyj(t),  respectively.  Uncertainty  A  Bo  in  Bo  is  thus 
represented  by  eriBi,  where  Bi  =  [0  l]r.  Thus,  the  closed-loop  system  corresponds  to 


Ao  BoCe 

BcCq  Ae 


‘=[ 

r=\r'  °]  V  = 

[o  oj  • 


0  BiCe 
0  0 


Vx  0 
0  BeVjBf 


where  the  zero  in  the  (2,2)  block  of  R  denotes  the  fact  that  we  are  considering  the  robust  perfor¬ 
mance  bound  for  the  state  regulation  cost  only.  Choosing  p  =  60,  it  follows  that  the  LQG  gains 
are  given  by 


Ae  = 


-9  1 

-20  -9 


Se=f}°l,  C.-1-10  -10]. 
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For  this  controller  the  actual  stability  region  corresponds  to  ax  6  (—.07,  .01)  (see  Figure  3).  Ap¬ 
plying  the  results  of  Section  5  with  V  =  R  =  0  (for  robust  stability  only)  and  ui  =  A  =  2,  we 
obtain 

=  £,  =  Zi  =  (-.000242,  .000242),  Z4  =  (-.000242,  .000728), 

=  (-.0000247,  .0000247),  Z's  =  (-.0000219,  .0000219), 

Z4  =  (-.0000247,  .0000265). 

Note  that  although  the  primal  results  are  better  than  the  dual  results  by  an  order  of  magnitude, 
they  are  conservative  by  two  orders  of  magnitude  with  respect  to  the  actual  gain  margin.  For 
robust  performance  we  again  set  w  =  A  =  2  and,  using  R  and  V  given  above,  we  obtained  the 
bound  tr  QR  =  7633  over  the  stability  region  Z4  —  (—.000192,  .000613).  The  nominal  performance 
was  given  by  tr  QoR  =  tr  PqV  =  4875,  while  the  dual  performance  bound  was  tr  PV  =  10510 
over  Z'4  =  (-.0000222,-0000238). 

Robustified  controllers  for  the  example  of  [19]  were  obtained  in  [20]  using  the  approach  discussed 
in  [13].  As  shown  in  Figure  3  (see  also  [20]),  the  closed-loop  system  with  the  controller 

A°  ~  -32.97  -5.295  ’  Be  =  [26.67  ’  C'  =  \ -6.245  -6.245], 

is  stable  over  the  range  aj  €  (-.28,  .21).  Hence  we  wish  to  determine  whether  the  robust  stability 
tests  are  capable  of  detecting  this  increase  in  gain  margin.  Applying  Theorems  3.1  and  4.1  with 
w  =  A  =  2  and  V  =  R  =  0  yields  stability  for  o\  in  the  regions  Z\  =  £a  =  £s  =  (—.0115,  .0115) 
and  Z4  —  (—.0115,  .057).  This  guarantee  of  stability  is  two  orders  of  magnitude  greater  than  the 
guarantee  for  the  LQG  design  but  is  still  an  order  of  magnitude  conservative  with  respect  to  the 
actual  stability  region  for  this  controller.  Note,  however,  that  for  <T\  >  0  the  guaranteed  gain 
margin  for  the  robustified  design  given  by  Z4  (i.e.,  .057)  is  greater  than  the  actual  gain  margin 
of  the  LQG  design  (.01).  Hence  the  robustness  test  given  by  the  Z4  was  able  to  detect  a  factor 
of  5  stability  augmentation  provided  by  the  robustified  design  compared  to  the  LQG  controller. 
Finally,  the  robust  performance  bound  for  this  controller  was  computed  to  be  tr  QR  =  11185  over 
the  region  Z4  =  (—.00165,  .00493),  while  the  dual  bound  was  found  to  be  tr  PV  =  11223  over 
Z\  =  (-.000724,  .00123).  For  this  problem  the  nominal  performance  is  tr  QoR  =  tr  PqV  =  9997. 
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Abstract 

For  a  given  asymptotically  stable  linear  dynamic  system  it  is  often  of  interest  to  determine 
whether  stability  is  preserved  as  the  system  varies  within  a  specified  class  of  uncertainties.  If,  in 
addition,  there  also  exist  associated  performance  measures  (such  as  the  steady-state  variances  of 
selected  state  variables),  it  is  desirable  to  assess  the  worst-case  performance  over  a  class  of  plant 
variations.  These  are  problems  of  robust  stability  and  performance  analysis.  In  the  present  paper 
we  consider  quadratic  Lyapunov  bounds  to  obtain  a  simultaneous  treatment  of  both  robust  stability 
and  performance.  The  approach  is  based  upon  the  construction  of  modified  Lyapunov  equations 
which  provide  sufficient  conditions  for  robust  stability  along  with  robust  performance  bounds.  One 
f  the  principal  features  of  the  paper  is  the  unified  treatment  and  extension  of  several  quadratic 
Lyapunov  bounds  developed  previously  for  feedback  control  design. 

Key  Words:  robust  analysis,  stability,  performance,  Lyapunov  equations,  structured  uncertainty 
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1.  Introduction 


Unavoidable  discrepancies  between  mathematical  models  and  real-world  systems  can  result  in 
degradation  of  control-system  performance  including  instability  ([1,2]).  Ideally,  feedback  control 
systems  should  be  designed  to  be  robust  with  respect  to  uncertainties,  or  perturbations,  in  the  plant 
characteristics.  Such  uncertainties  may  arise  either  due  to  limitations  in  performing  system  iden¬ 
tification  prior  to  control-system  implementation  or  because  of  unpredictable  plant  changes  which 
occur  during  operation.  Thus  robustness  analysis  must  play  a  key  role  in  control-system  design. 
That  is,  given  an  existing  or  proposed  control  system,  determine  the  performance  degradation  due 
to  variations  in  the  plant. 

In  performing  robustness  analysis  there  are  two  principal  concerns,  namely,  stability  robustness 
and  performance  robustness.  Stability  robustness  addresses  the  qualitative  question  as  to  whether 
or  not  the  system  remains  stable  for  all  plant  perturbations  within  a  specified  class  of  uncertainties. 
A  related  problem  involves  determining  the  largest  class  of  plant  perturbations  under  which  stability 
is  preserved.  Once  robust  stability  has  been  ascertained,  it  is  of  interest  to  determine  quantitatively 
the  degradation  of  performance  within  a  given  robust  stability  range.  In  practice  it  is  often  desirable 
to  determine  the  worst  case  performance  as  a  measure  of  degradation. 

The  concern  for  both  robust  stability  and  performance  can  be  traced  back  to  the  earliest  devel¬ 
opments  in  control  theory.  Design  specifications  such  as  gain  and  phase  margin  have  traditionally 
been  used  to  gauge  system  reliability  in  the  face  of  uncertainty.  In  the  modern  control  literature 
considerable  effort  has  focused  on  rigorous  robustness  analysis  and  design  techniques  in  a  variety 
of  settings.  Analysis  and  synthesis  results  have  been  developed  for  both  state-space  and  frequency- 
domain  plant  models  to  address  structured  parameter  variations  as  well  as  normed-neighborhood 
uncertainty  ([3-7]). 

The  present  paper  is  concerned  solely  with  the  analysis  of  structured  real-valued  parameter 
uncertainty  within  the  context  of  state  space  models.  Motivation  for  such  problems  is  clearly  il¬ 
lustrated  by  simple  examples  given  in  [1,2].  These  examples  show  that  standard  linear-quadratic 
methods  used  to  design  either  full-state  feedback  controllers  or  dynamic  compensators  may  result  in 
closed-loop  systems  which  are  arbitrarily  sensitive  to  structured  real-valued  plant  parameter  vari¬ 
ations.  A  particularly  effective  technique  for  analyzing  robust  stability  is  to  construct  a  Lyapunov 
function  which  guarantees  stability  of  the  system  as  the  uncertain  parameters  vary  over  a  specified 
range.  Using  the  quadratic  Lyapunov  function  V(z)  =  xTPx  this  technique  has  been  extensively 


developed  for  both  analysis  and  synthesis  (see,  e.g.,  [8-37]). 

Although  both  robust  stability  and  performance  are  of  interest  in  practice,  most  of  the  literature 
involving  quadratic  Lyapunov  functions  is  confined  to  the  problem  of  robust  stability.  A  notable 
exception  is  the  early  work  of  Chang  and  Peng  ([9])  which  also  provides  bounds  on  worst-case 
quadratic  performance  within  full-state  feedback  control  design.  In  the  present  paper  we  further 
extend  the  approach  of  [9]  to  obtain  a  series  of  results  for  analyzing  both  robust  stability  and 
performance.  As  will  be  seen,  these  results  also  provide  substantial  unification  of  more  recent 
results  pertaining  only  to  robust  stability. 

To  illustrate  the  basis  for  our  approach,  consider  the  system 

i(t)  =  (A  +  AA)x(t)  +  Dow(t),  (1.1) 

where  x(t)  is  an  n-vector,  A  is  an  n  x  n  matrix  denoting  the  nominal  dynamics  matrix,  AA  denotes 
an  uncertain  perturbation  of  A  belonging  to  a  specified  set  U,  and  D0w(t)  is  (for  now)  a  white 
noise  signal  of  specified  intensity  V  =  DqDq  .  System  (1.1)  may,  for  example,  denote  a  control 
system  in  closed-loop  configuration.  For  the  system  (1.1)  the  performance  involves  the  steady-state 
covariance  of  specified  outputs  E0x(t).  In  practice  the  diagonal  elements  of  the  output  covariance 
are  measures  of  the  ability  of  the  external  disturbances  Dow(t)  to  affect  specified  states.  In  the 
presence  of  uncertainties  AA ,  it  is  of  interest  to  determine  the  worst  ease  steady-state  values  of 
selected  state  variances.  Thus,  we  define  the  scalar  performance  criterion 

J$(U)  =  sup  limsupE  j[2^*(0]T[£o*(0]  }>  (1.2) 

where  “E”  denotes  expectation.  To  evaluate  (1.2)  define  the  state  covariance 

<J(t)  &  B[*(»)*T(l)],  (1-3) 

which  satisfies  the  Lyapunov  differential  equation 

Qnx(0  =  [A  +  AA)QAA{t)  +  Q^(t)(A  +  AA)T  +  V,  (1.4) 

so  that  (1.2)  becomes 

Js{U)  =  sup  limsup  tt  QAA{t)R,  (1.5) 

AASU  t~*oo 

where  R  =  EqEq.  To  guarantee  both  robust  stability  and  performance  we  consider  modified 
algebraic  Lyapunov  equations  of  the  form 

0  =  AQ  +  QAT  +  n{Q)+V  (1.6) 
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where  !?(*)  is  a  matrix  operator  satisfying 

AAQ  +  QAAr  <  n{Q)  (1.7) 

for  all  AA  €  U  and  all  nonnegative-definite  matrices  Q.  The  ordering  in  (1.7)  is  defined  with 
respect  to  the  cone  of  nonnegative-definite  matrices.  Our  results  are  based  on  the  following  robust 
stability  and  performance  result.  If  there  exists  a  nonnegative-definite  solution  Q  to  (1.6)  where 
1?(-)  satisfies  (1.7),  then  A+  AA  is  asymptotically  stable  for  all  AA  €  U  and,  furthermore, 

MU)  <  tr  QR •  (1.8) 

The  performance  bound  (1.8)  follows  from  the  fact  that  since  A  +  A  A  is  asymptotically  stable, 
Qaa  =  limt-»oo  Q<ja(0  exists  and  satisfies 

0=(A+AA)Qaa  +  Qaa(A+AA)t  +  V.  (1.9) 

Now  subtracting  (1.9)  from  (1.6)  implies 

Qaa  <  Q,  (1.10) 

which  with  (1.5)  yields  (1.8). 

Since  the  ordering  induced  by  the  cone  of  nonnegative-definite  matrices  is  only  a  partial  order¬ 
ing,  it  should  not  be  expected  that  there  exists  an  operator  /?(■)  satisfying  (1.7)  which  is  a  least 
upper  bound.  Indeed,  connections  between  the  result  outlined  above  and  the  approach  of  [9]  as 
well  as  more  recent  work  arise  from  alternative  definitions  of  the  operator  /?(•).  To  illustrate  these 
connections  assume  for  convenience  that  AA  is  of  the  form 

AA  =  <riAi,  ki|  <  «i,  (1-11) 

where  <j\  is  an  uncertain  real  scalar  parameter  assumed  only  to  satisfy  the  stated  bounds,  and  Ax 
is  a  known  matrix  denoting  the  structure  of  the  parametric  uncertainty.  The  original  definition  of 
/?(•)  in  [9]  was  given  by 

n(g)  =  ^1|A1g  +  gAf|,  (1.12) 

where  |  •  |  denotes  the  nonnegative-definite  matrix  obtained  by  replacing  each  eigenvalue  by  its 
absolute  value.  This  bound  was  studied  in  [9,12]  for  full-state  feedback  design.  More  recently,  the 
quadratic  bound 

rt(Q)  =  «i[0 +  <?£<?]  (1.13) 
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has  been  considered,  where  D  =  D\D±t  E  =  E±  E\,  and  D\,E\  are  a  factorization  of  Ai  of  the 
formAi  =  D\E\.  Bound  (1.13)  was  studied  in  [29]  for  robustness  analysis  and  in  [17,25,28,30,33,36] 
for  robust  controller  synthesis.  A  third  bound  which  has  also  been  considered  is  the  linear  bound 

f]{Q)  =  *![ag  +  a^AiQA?],  (1.14) 

where  at  is  an  arbitrary  positive  scalar.  As  shown  in  [33],  bound  (1.14)  arises  from  a  multiplicative 
white  noise  model  with  exponential  disturbance  weighting.  Control-design  applications  of  bound 
(1.14)  are  given  in  [23,27,33,34,35]. 

The  principal  contribution  of  the  present  paper  is  thus  a  unified  development  of  bounds  (1.12)- 
(1.14)  for  both  robust  stability  and  performance  analysis.  In  addition,  we  present  a  systematic 
approach  which  pays  careful  attention  to  the  structure  of  the  uncertainty  set  U.  For  example,  we 
show  that  bound  (1.12)  guarantees  stability  over  a  rectangular  uncertainty  set  while  (1.14)  is  most 
naturally  associated  with  an  ellipsoidal  region.  Furthermore,  to  provide  a  methodical  development, 
we  consider  three  classes  of  bounds  (Type  I,  II  and  III)  which  operate  by  exploiting,  respectively, 
the  symmetry  of  AAQ  +  QAAr,  the  structure  of  Q,  and  the  structure  of  AA.  This  approach 
clarifies  the  relationships  among  different  bounds  and  suggests  several  new  bounds. 

Finally,  the  present  paper  also  considers  an  alternative  functional  for  robust  performance  anal¬ 
ysis.  Specifically,  in  place  of  white  noise  disturbances,  we  reinterpret  to (t)  in  (1.1)  as  a  deterministic 
Zrj  signal  as  in  theory  ([6]).  By  imposing  an  norm  on  the  output  Eox(t),  the  corresponding 
perform  wee  measure  is  given  by  (see  [38]) 

Jx>(U)=  sup  lim  sup  \m*x{Q  A  a  (0  R) ,  (115) 

AA&l  t— »oo 

in  contrast  to  (1.5).  Both  performance  measures  Js{U)  and  Jo(U)  are  considered  in  the  paper. 

The  contents  of  the  paper  are  as  follows.  After  summarizing  notation  later  in  this  section, 
the  Robust  Stability  Problem,  Stochastic  Robust  Performance  Problem,  and  Deterministic  Robust 
Performance  Problem  are  introduced  in  Section  2.  In  Section  3  the  basic  result  guaranteeing  robust 
stability  and  performance  (Theorem  3.1)  is  stated.  This  result  is  easily  stated  and  forms  the  basis  for 
all  later  developments.  A  dual  version  of  Theorem  3.1  (Theorem  4.1)  provides  additional  sufficient 
conditions  and  clarifies  connections  to  traditional  robust  stability  results.  The  bound  !?(•)  and  its 
dual  A(’)  are  given  concrete  forms  in  Section  5.  In  Section  6,  the  bounds  of  Section  5  are  merged  with 
Theorem  3.1  to  yield  the  main  results  guaranteeing  robust  stability  and  performance  (Theorems 
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6.1-&5)  via  modified  Lyapunov  equations.  In  Section  7  we  analyze  the  modified  Lyapunov  equations 
with  regard  to  existence,  uniqueness,  and  monotonicity  of  solutions.  Additional  bounds  are  derived 
in  Section  8  by  utilizing  a  recursive  substitution  technique,  while  both  upper  and  lower  bounds  are 
obtained  in  Section  9.  Finally,  illustrative  numerical  examples  are  considered  in  Sections  10  and 
11. 

Notation 


Note:  All  matrices  have  real  entries 

IR, IRrX*,IRr,IE  real  numbers,  r  x  a  real  matrices,  IRrxl,  expectation 

I r  r  x  r  identity  matrix 

asymptotically  matrix  with  eigenvalues  in  open  left  half  plane 

stable  matrix 


Sr 

INr 

IPr 

Z\  Za 
Z\  >  Za 
tr  Z,  ZT 
A i(Z) 

A  m~{Z) 


r  x  r  symmetric  matrices 

r  x  r  symmetric  nonnegative-definite  matrices 

r  x  r  symmetric  positive-definite  matrices 

Z1-Za€lNr,  Zi,Z3€Sr 

Z\  —  Za  €  IPr,  Z\,  Z a  €  Sr 

trace  of  Z,  transpose  of  Z 

eigenvalue  of  matrix  Z 

maximum  eigenvalue  of  matrix  Z  having  real  spectrum 


2.  Robust  Stability  and  Performance  Problems 

Let  U  C  IRnXn  denote  a  set  of  perturbations  AA  of  a  given  nominal  dynamics  matrix  A  € 
jpnxn  Throughout  the  paper  it  is  assumed  that  A  is  asymptotically  stable  and  that  0  €  U.  We 
begin  by  considering  the  question  of  whether  or  not  A+AA  is  asymptotically  stable  for  all  A  A  €  U. 

Robust  Stability  Problem.  Determine  whether  the  linear  system 

±(t)  =  (A  +  AA)x{t),  t  €  [0,  oo),  (2.1) 

is  asymptotically  stable  for  all  A  A  €  U. 

To  consider  the  problem  of  robust  performance  it  is  necessary  to  introduce  external  distur¬ 
bances.  In  this  paper  we  consider  both  stochastic  and  deterministic  disturbance  models.  The 
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stochastic  disturbance  model  involves  white  noise  signals  as  in  standard  LQG  theory  while  the  de¬ 
terministic  disturbance  model  involves  £3  signals  as  in  Hoo  theory  ([6]).  By  defining  an  appropriate 
performance  measure  for  each  disturbance  class  it  turns  out  that  we  can  provide  a  simultaneous 
treatment  of  both  cases. 

We  first  consider  the  case  of  stochastic  disturbances.  In  this  case  the  robust  performance  prob¬ 
lem  concerns  the  worst-case  magnitude  of  the  expected  value  of  a  quadratic  form  [£oz(t)]T[j%x(t)], 
where  the  matrix  Eq  €  lR4Xn  defines  the  output  states,  when  the  system  is  subjected  to  a  standard 
white  noise  disturbance  w(t)  €  IR*  with  weighting  Do  €  IRnx<1. 

Stochastic  Robust  Performance  Problem.  For  the  disturbed  linear  system 


x(i)  =  (A  +  AA)x(t)  +  D0w(t),  t  €  [0, 00), 


(2.2) 


where  w(-)  is  a  d-dimensional  white  noise  signal  with  intensity  I4,  determine  a  performance  bound 
0s  satisfying 

Jrs(U)=  sup  hmsupE{[isb*(0]T[^W*)]}  £  £s-  (2.3) 

The  system  (2.2)  may  denote,  for  example,  a  control  system  in  closed-loop  configuration  sub¬ 
jected  to  external  white  noise  disturbances  for  which  z(t)  =  E0x(t)  may  be  the  state  regulation 
error.  Such  specializations  are  not  required  for  this  development,  however. 

Of  course,  since  Eq  and  Do  may  be  rank  deficient,  there  may  be  cases  in  which  a  finite  perfor¬ 
mance  bound  0s  satisfying  (2.3)  exists  while  (2.1)  is  not  asymptotically  stable  over  U.  In  practice, 
however,  robust  performance  is  mainly  of  interest  when  (2.1)  is  robustly  stable.  In  this  case  the 
performance  Js(U)  is  given  in  terms  of  the  steady-state  second  moment  of  the  state.  The  following 
result  from  linear  system  theory  will  be  useful.  For  convenience  define  the  nxn  nonnegative-definite 
matrices 


R  ±  EfEo,  V  4  DoDj. 

Lemma  2.1.  Suppose  (2.1)  is  asymptotically  stable  for  all  AA  €  U.  Then 

J3(U)  =  sup  tr  QaaR, 
aagu 

where  nxn  Qaa  =  limt_oo  IE [x(t)xT(t)j  is  given  by 

Qaa  =  f  e(^+4A)Ve(A+dA)Ttdt, 

Jo 


(2.4) 


(2.5) 


(2.6) 
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which  is  the  unique,  nonnegative-definite  solution  to 

0=(A  +  4A)QAA  +  QAA(A+4A)T-i-V'.  (2.7) 

To  state  the  Deterministic  Robust  Performance  Problem  some  additional  notation  is  required. 
For  a  measurable  function  w  :  [0,  oo)  — *  IRd  define 

=  (2.8) 

Note  that  definition  (2.8)  is  an  L*  function  norm  with  a  Euclidean  spatial  norm.  We  now  reconsider 
(2.2)  with  «>(•)  now  interpreted  as  a  square-integrable  function.  In  this  case  the  robust  performance 
problem  concerns  the  worst-case  norm  of  a  quadratic  form  [Eox(t)]r[Eox(t)]. 

Deterministic  Robust  Performance  Problem.  For  the  disturbed  linear  system  (2.2), 
where  ||w(')|U  ^  1.  determine  a  performance  bound  satisfying 

Jd(U)  =  sup  sup  sup  ( [i?o*(0] T [-^o*(0] }  ^  &>*  (2.9) 

AAell  Il«(0lla<l  telO.oo)  t  > 

The  following  result  is  proved  in  [38]. 

Lemma  2.2.  Suppose  (2.1)  is  asymptotically  stable  for  all  AA  E  U.  Then 

MU)=  sup  A m«(gAAR),  (2.10) 

where  Qaa  is  the  unique,  nonnegative-definite  solution  to  (2.7). 

Remark  2.1.  Although  Js(Zl)  and  Jv(U)  arise  from  different  mathematical  settings  they  are 
quite  similar  in  form.  Note  that  in  general  Jd(U)  <  Js(U),  and  Jq(U)  =  Js(U)  if  rank  R  =  1. 

Remark  2.2.  In  Lemma  2.2  Qaa  can  be  viewed  as  the  controllability  Gramian  for  the  pair 
(A  +  AA,  Do)  rather  than  the  state  covariance. 

In  the  present  paper  our  approach  is  to  obtain  robust  stability  as  a  consequence  of  sufficient 
conditions  for  robust  performance.  Such  conditions  are  developed  in  the  following  sections. 

3.  Sufficient  Conditions  for  Robust  Stability  and  Performance 

The  key  step  in  obtaining  robust  stability  and  performance  is  to  bound  the  uncertain  terms 
AAQ  +  QAAt  in  the  Lyapunov  equation  (2.7)  by  means  of  a  function  D{Q)-  The  nonnegative- 
definite  solution  Q  of  this  modified  Lyapunov  equation  is  then  guaranteed  to  be  an  upper  bound 
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for  Qaa-  The  following  easily  proved  result  is  fundamental  and  forms  the  basis  for  all  later 
developments.  The  hypothesis  of  this  result  are  of  a  general  nature  and  are  not  intended  to  be 
directly  verifiable.  Suitably  verifiable  hypotheses  are  discussed  later. 

Theorem  3.1.  Let  H  :  IN"  — ►  IN"  be  such  that 

AAQ  +  QAAr  <  n(Q),  AA  €  U,  Q  €  IN",  (3.1) 

and  suppose  there  exists  Q  €  IN"  satisfying 

0  =  AQ  +  QAr  +n(Q)+V.  (3.2) 

Then 

(A  +  AA,  [V  +  n(Q)  -  ( AAQ  +  Q  AAT)] is  stabilizable,  AA  €  U,  (3.3) 

if  and  only  if 

A  +  AA  is  asymptotically  stable,  AA  €  U.  (3.4) 

In  this  case, 

Qaa<Q,  AAeU,  (3.5) 

where  Qaa  €  IN"  is  given  by  (2.7),  and 

MU)  <  tr  QR,  (3.6) 

Jd{U)  <  \mmx(QR).  (3.7) 

In  addition,  there  exists  AA  €  U  such  that  (a+ AA,  [V +n(Q)-(AAQ+QAAr)]  ^  is  controllable 
if  and  only  if  Q  is  positive  definite.  In  this  case  ^A  +  AA,  [V  +  fJ(Q)  -  (AAQ  +  <2AAT)]^  is 
controllable  for  all  A  A  €  U. 

Proof.  We  stress  that  in  (3.1)  “Q"  denotes  an  arbitrary  element  of  IN"  while  Q  in  (3.2)  denotes 
* 

a  specific  solution  of  the  modified  Lyapunov  equation.  This  minor  abuse  of  notation  considerably 
simplifies  the  presentation.  Now  note  that  for  all  A  A  €  IR"X"  (3.2)  is  equivalent  to 

0  =  (A  +  AA)Q  +  Q(A  +  AA)t  +  f](Q)  -  ( AAQ  +  QAAT)  +  V.  (3.8) 

Hence,  by  assumption  (3.8)  has  a  solution  Q  €  IN"  for  all  AA  €  IR"X".  If  AA  is  restricted  to  the  set 
U  then  by  (3.1)  0(Q)  —  ( AAQ+QAAr )  is  nonnegative  definite.  Now  if  the  stabilizability  condition 
(3.3)  holds  for  all  AA  €  U,  it  follows  from  Lemma  12.2  of  [39]  that  A  +  AA  is  asymptotically  stable 
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for  all  AA  €  U.  Conversely,  if  A  +  AA  is  asymptotically  stable  for  all  AA  S  U,  then  (3.3)  holds. 
Next,  subtracting  (2.7)  from  (3.8)  yields 

0  =  (A  +  AA)(Q  -  Qaa)  +  (Q~  Qaa)(A  +  AA)r  +  n{Q)  -  ( AAQ  +  QAA T),  AA  €  U, 
or,  equivalently,  (since  A  +  A  A  is  asymptotically  stable  for  all  A  A  €  U) 

Q  -  Qaa  =  f  .(*+**>•  [flfQ)  -  (4A<3  +  <J4AT)]e<x+<aA>Tt<fc  >  0,  AA  €  U, 

J  0 

which  implies  (3.5).  The  performance  bound  (3.6)  is  now  an  immediate  consequence  of  (3.5). 
To  prove  (3.7)  we  note  that  it  follows  from  Corollary  7.7.4  of  [40]  that  if  0  <  Mi  <  Mj  then 
^mtt(Wi)  S  Ammx(-Wi)-  Thus 

Jx>(U)  =  ABax(gAAR)  =  X^EoQaaEJ)  <  Xmtx(E0QEj)  =  Xm„(QR).  (3.9) 

Finally,  it  follows  from  (3.8)  that  the  controllability  condition  holds  for  some  AA  €  U  if  and  only 
if  the  Gramian  Q  is  positive  definite.  Since  Q  is  also  the  Gramian  corresponding  to  A  +  A  A  for  all 
AA  €  U,  then  controllability  holds  for  all  AA  €  U.  □ 

For  convenience  we  shall  say  that  TJ(-)  bounds  U  if  (3.1)  is  satisfied.  To  apply  Theorem  3.1,  one 
first  specifies  a  function  /?(•)  and  an  uncertainty  set  U  such  that  /?(■)  bounds  U.  If  the  existence  of 
a  nonnegative-definite  solution  Q  to  (3.2)  satisfying  (3.3)  or,  equivalently,  (3.4)  can  be  determined 
analytically  or  numerically,  then  robust  stability  is  guaranteed.  One  can  then  enlarge  U,  modify 
!?(•),  and  again  attempt  to  solve  (3.2).  If,  however,  a  nonnegative-definite  solution  to  (3.2)  cannot 
be  determined,  then  U  must  be  decreased  in  size  until  (3.2)  is  solvable.  For  example,  J?(-)  can  be 
replaced  by  etf(-)  to  bound  eU,  where  e  >  1  enlarges  U  and  e  <  1  shrinks  U.  Of  course,  the  actual 
range  of  uncertainty  which  can  be  bounded  depends  upon  the  nominal  matrix  A,  the  function  H(-), 
and  the  structure  of  U.  In  Section  5  the  uncertainty  set  U  and  bound  !?(•)  satisfying  (3.1)  are  given 
concrete  forms.  We  complete  this  section  with  several  observations. 

Remark  3.1.  In  applying  Theorem  3.1  it  may  be  convenient  to  replace  condition  (3.3)  with 
a  stronger  condition  which  is  easier  to  verify  in  practice.  Clearly,  (3.3)  is  satisfied  nv  +  n(Q)~ 
(AAQ  +  QAAT)  is  positive  definite  for  all  A  A  €  U.  This  will  be  the  case,  for  example,  if  either  V 
is  positive  definite  or  strict  inequality  holds  in  (3.1).  Also,  it  follows  from  Theorem  3.6  of  [39]  that 
(3.3)  is  implied  by  the  stronger  condition 


(A  +  A  A,  V  i )  is  stabilizable,  A  A  €  U . 


(3.10) 


Similar  remarks  apply  to  the  controllability  condition. 

Remark  3.2.  If  only  robust  stability  is  of  interest,  then  the  noise  intensity  V  need  not  have 
physical  significance.  In  this  case  one  may  either  set  V  =  eln  where  e  >  0  is  small  to  satisfy  V  >  0, 
or  set  V  =  0  and  require  that  strict  inequality  hold  in  (3.1). 


Remark  3.3.  Since  A  is  stable  Q  satisfying  (3.2)  is  given  by 


Q=  f°°  eAt[n(Q)  +  V]eATtdtt 

Jo 

(3.11) 

or,  equivalently, 

Q=  eAtn{Q)eATtdt  +  Q0, 

Jo 

(3.12) 

where  Qo  €  IN'*  is  defined  by 

Qo  =  eAtVeATtdt 

Jo 

(3.13) 

and  satisfies 

0  =  AQq  +  QoAT  +  V. 

(3.14) 

Note  that  Qo  <  Q  and  that  the  nominal  performances  7s  ({0})  and  7d({0})  are  given  by  tr  QqR 
and  Xmtx{Q0R),  respectively. 

Remark  3.4.  Using  (3.11)  it  is  also  useful  to  note  that  the  bound  for  Js(U)  given  by  (3.6) 
can  be  written  as 

tr  QR  =  tr  f°°  eAt  [fl(Q)  +  V)eATtdtR  =  tr  P0  [fl(Q)  +  V] ,  (3.15) 

Jo 

where  Pq  €  IN"  is  defined  by 

P0  =  [-<**»*  (3.16) 

Jo 

and  satisfies 

0  =  A?  Pq  +  PqA  +  R.  ,(3.17) 

The  bound  tr  Pq\P(Q)  +  V]  can  be  viewed  as  a  dual  formulation  of  the  bound  tr  QR  since  the 
roles  of  A  and  A T  are  reversed.  Dual  bounds  are  developed  in  the  following  section.  Note  that 
tr  Q0R  —  tr  PqV. 

Remark  3.5.  If  /?(•)  bounds  U  then  clearly  !?(•)  bounds  the  convex  hull  of  U.  Hence,  only 
convex  uncertainty  sets  U  need  be  considered.  Next,  we  shall  later  use  the  obvious  fact  that  if  fl'(-) 
bounds  li'  and  !?"(•)  bounds  U",  then  !?'(•)  +/7"(-)  bounds  U'  +  U".  Hence  if  U  can  be  decomposed 
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additively  then  it  suffices  to  bound  each  component  separately.  Finally,  if  /?(•)  bounds  U  and  there 
exists  tV  :  INn  — *  INn  such  that  tJ{Q)  <  tV{Q)  for  all  Q  €  INn,  then  /?'(•)  also  bounds  U.  That  is, 
any  overbound  fl'(-)  for  /?(•)  also  bounds  U.  Of  course,  as  we  shall  see,  it  is  quite  possible  that  an 
overbound  t7'(-)  for  CJ(-)  may  bound  a  set  U'  which  is  larger  than  the  “original”  uncertainty  set  U. 

4.  Dual  Sufficient  Conditions  for  Robust  Stability  and  Performance 

As  noted  in  Remark  3.4,  the  performance  bound  tr  QR  given  by  (3.6)  can  be  expressed  equiv¬ 
alently  in  terms  of  a  dual  variable  Pq  for  which  the  roles  of  A  and  AT  are  reversed.  Using  a  similar 
technique,  additional  conditions  for  robust  stability  and  performance  can  be  obtained  by  devel¬ 
oping  a  dual  version  of  Theorem  3.1.  A  prime  motivation  for  developing  such  dual  bounds  is  to 
draw  connections  with  previous  results  in  the  literature  relating  to  robust  stability.  In  particular, 
note  that  traditional  robust  stability  techniques  based  upon  the  Lyapunov  function  V(x)  =  xTPx 
lead  to  dual  conditions.  Robust  performance  bounds  within  the  dual  formulation  are  difficult  to 
motivate  without  first  developing  the  primal  performance  bounds.  In  addition,  the  dual  bounds 
may,  for  certain  problems,  yield  larger  stability  regions  and  sharper  performance  bounds  than  the 
“primal”  bounds  introduced  in  the  previous  section. 

Lemma  4.1.  Suppose  (2.1)  is  asymptotically  stable  for  all  AA  €  U.  Then 

Js{U)  =  sup  tr  PaaV,  (4.1) 

aasu 

where  n  x  n  Pa  a  is  the  unique,  nonnegative-  definite  solution  to 

0  =  (A  +  AA^Paa  +  Paa{A  +  AA)  +  R.  (4-2) 

Proof.  It  need  only  be  noted  that 

/•oo 

tr  QaaR=  tr  /  tdtR=  tr  pAJyt 

Jo 

where 

Paa=  [ °°  JA+*A)v*RjA+AA)tdt 
Jo 

satisfies  (4.2).  □ 

The  proof  of  Lemma  4.1  relied  on  the  fact  that  tr  QaaR  —  tr  PaaV ■  However,  it  is  not 
necessarily  true  that  A m*x{QAAR)  =  A m%x{PAAV)  even  when  AA  =  0.  For  example,  if  A  = 
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[~o  -j3»S  =  **>  and  y  =  [J  3]  then  =  [J3  $]  “d  P*V  «  [x/4  1/*]  “d  thus  AmMC(Q0/2)  = 
(15  +  Vl45)/24  and  Amtx(P0V)  =  (5  +  \/l7)/8.  Thus  to  obtain  a  suitable  dual  version  of  Jz>(U) 
we  need  to  define  a  dual  deterministic  cost  This  can  be  done  if  the  disturbance  signals  are 

taken  to  be  integrable  rather  than  square  integrable.  Thus,  for  measurable  w  :  [0,  oo)  — » IR*  define 

IKOIU  ~f  [wT(t)u/(t)]*£ft,  (4-3) 

Jo 

which  is  an  Li  function  norm  with  a  Euclidean  spatial  norm.  The  dual  deterministic  cost  JD(Zi)  is 
thus  defined  by 

Jd(£J)  =  sup  sup  ||£x(*)lia>  (4.4) 

where  Ex{-)  is  measured  according  to  the  energy  norm  (2.8).  The  following  dual  result  can  also  be 
found  in  [38]. 

Lemma  4.2.  Suppose  (2.1)  is  asymptotically  stable  for  all  AA  €  U.  Then 

MU)  =  K~{PaaV),  (4.5) 

where  Paa  is  the  unique,  nonnegative-definite  solution  to  (4.2). 

The  dual  version  of  Theorem  3.1  can  now  be  stated. 

Theorem  4.1.  Let  A  :  INn  — » IN”  be  such  that 


AAtP  +  PAA  <  A(P),  AAeU ,  P  €  IN'*, 

(4.6) 

and  suppose  there  exists  P  e.  IN'*  satisfying 

0  =  AtP  +  PA  +  A{P)  +  R. 

(4.7) 

Then 

^[f?  +  A(P)  —  ( AAtP  +  PAA)\  ^ ,  A  +  AA^j  is  detectable,  AA  e  U, 

(4.8) 

if  and  only  if 

A  +  A  A  is  asymptotically  stable,  A  A  e  U. 

(4.9) 

In  this  case, 

Paa<P,  AAEU , 

(4.10) 

where  Paa  is 

given  by  (4.2),  and 

MW  S  tr  PV, 

(4.11) 

12 


Mu)  <  AmfcX(PV).  (4.12) 

In  addition,  there  exists  AA  €  U  such  that  ([R+A{P)-(AAtP+PAA)]*,A+AA)  is  observable 
if  and  only  if  P  is  positive  definite.  In  this  case  ([R  +  A(P)  -  (AAtP  4-  PAA)]^ , A  +  AA)  is 
observable  for  all  A  A  6  U. 

Proof.  The  proof  is  completely  analogous  to  the  proof  of  Theorem  3.1.  □ 

Remark  4.1.  Note  that  Jo(U)  <  J$(U)  and  Jv(U)  =  Js(Zi)  if  rank  V  =  1.  Combining  this 
fact  with  Remark  2.1,  it  follows  that  Jd(U)  =  Jv(U)  if  both  rank  R  =  1  and  rank  V  —  1. 

It  is  quite  possible  that  the  bounds  tr  QR  and  tr  PV  for  Js(U)  given  by  (3.6)  and  (4.11)  may 
be  different  in  spite  of  the  fact  as  shown  in  the  proof  of  Lemma  4.1  that  tr  Q&aR  =  tr  PaaV. 
That  is,  depending  upon  /?(*)  and  d(>)  either  bound  (3.6)  or  bound  (4.11)  may  be  better  for  a 
particular  problem.  In  general,  we  have  the  following  result. 

Proposition  4.1.  Let  ft(-)|d('),Q,  and  P  be  as  in  Theorems  3.1  and  4.1,  and  let  Q0  and  P0 
be  given  by  (3.13)  and  (3.16),  respectively.  Then 

tr  QoA(P)  <  tr  PoO(Q)  <=>  tr  QR  >  tr  PV, 

tr  Qod(P)  =  tr  Pbn(Q)  <=>  tr  QR-  tr  PV, 

tr  QqA(P)  >  tr  Pq!7(Q)  <=>  tr  QR  <  tr  PV. 

Proof.  Note  that 

tr  QR  =  f  eAt  [fl(Q)  +  V]  eAT*dt  R  =  tr  P0n{Q)  +  tr  [ °°  eMVeATtdt  R 
Jo  Jo 

and 

tr  PV  =  tr  [°°  eATt[A{P)  +  R]eAtdtV  =  tr  Q0d(P)  +  tr  eATtReAtdtV 

Jo  Jo 

so  that 

tr  QR  -  tr  PV  =  tr  PoH(Q)  -  tr  QqA(P), 
which  yields  (4.13)-(4.15).  □ 

Remark  4.2.  Finally,  as  shown  by  example  above,  it  is  not  generally  true  that  Jv(U)  =  Jn{U). 
Similarly,  we  should  not  expect  that  the  bounds  \m*x{QR)  and  Amax(PV)  for  Jv(U)  and  Jd{U) 
given  by  (3.7)  and  (4.12)  are  equal. 


(4.13) 

(4.14) 

(4.15) 
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5.  Construction  of  the  Bounds  /7(-)  and  A(-) 

As  discussed  in  Section  1,  we  consider  three  distinct  classes  of  bounds  /?(•)  denoted  by  Type  I, 
Type  II,  and  Type  HI.  Roughly  speaking,  these  bounds  exploit,  respectively,  the  symmetry  of  the 
Lyapunov  terms  AAQ  +  QAAT ,  the  structure  of  Q,  and  the  structure  of  A  A.  The  dual  bounds 
d(-)  can  be  constructed  similarly  by  replacing  Q  and  A  A  by  P  and  AAr.  Hence  these  bounds 
will  not  be  discussed  separately.  For  convenience  in  discussing  the  set  U,  we  shall  use  the  terms 
rectangle  and  ellipse  to  refer  to  closed  regions  bounded  by  such  figures  in  multiple  dimensions.  As 
usual,  a  polytope  is  the  convex  hull  of  a  finite  number  of  points. 

5.1  Type  I  Bounds 

We  begin  by  constructing  bounds  /}(•)  which  exploit  only  the  symmetry  of  the  Lyapunov  terms 
AAQ  4-  QAA T.  First  we  require  the  following  definition  of  a  function  of  a  symmetric  matrix  as  an 
extension  of  a  real-valued  function  ([40],  p.  300).  Specifically,  if  /:  IR  — ►  1R  then  (with  a  minor 
abuse  of  notation)  /:  Sn  — »  Sn  can  be  defined  by  setting 

f{S)±Uf(D)Ur, 

where  S  =  UDUT,  U  is  orthogonal,  D  is  real  diagonal,  and  f(D)  is  the  diagonal  matrix  obtained 
by  applying  /  to  each  diagonal  element  of  D.  Note  that  if  •/  is  the  polynomial  f[x)  =  £J_0  o,x’ 
then  f(S)  =  0OiS'.  Note  also  that  if  f{x)  =  ]*|  then  f(S)  =  (Ss)i,  where  (•)*  denotes  the 
(unique)  nonnegative-definite  square  root.  As  in  [41],  p.  262,  we  use  the  notation  |S|  to  denote 
(S*)».  Finally,  note  that  if  /:  IR  — *  IR  and  g:  IR  — ►  IR  are  such  that  /(x)  <  g{x),  x  €  IR,  then 
f(S)<g{S),  S  €  Sn. 

As  a  concretization  of  the  uncertainty  set  U,  consider  the  set 

&i={4A€nrx":  dA  =  £<TiA<,  |  <fi  |<  Si,  .  =  l,...,p},  (5.1) 

i=l 

-.irhere,  for  i  =  l,...,p  :  A*  €  IRnXn  is  a  given  matrix  denoting  the  structure  of  the  parametric 
uncertainty;  <j%  is  a  real  uncertain  parameter;  and  Si  denotes  the  range  of  parameter  uncertainty. 
Clearly,  the  multidimensional  set  of  uncertain  parameters  (o^ ,  . . . , <rp)  is  the  rectangle  [-£i,£i]  x 
...  x  [-$,,, $,,]  and  Hi  is  a  symmetric  polytope  of  matrices  in  IRnxn.  Note  that  the  symmetry  of 
the  uncertainty  interval  [— 5<,5<]  entails  no  loss  of  generality  since  the  nominal  value  of  A  can  be 
redefined  if  necessary.  Furthermore,  it  is  also  possible,  without  loss  of  generality,  to  define  5,-  =  1 
by  replacing  Ai  by  For  clarity,  however,  we  choose  not  to  employ  this  scaling. 
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We  begin  by  considering  the  absolute* value  bound  utilized  by  Chang  and  Peng  in  [9]. 


Proposition  5.1.  The  function 

»=i 

bounds  Ui. 


Proof.  For  *  =  1, . . .  ,p  and  |o<|  <  Si, 

0i(AiQ  +  QAj)  <  \<Ti(AiQ  +  QAj) |  =  | <n\\AiQ  +  QA?(  <  S^AiQ  +  QAj \. 


(5.2) 


Thus,  summing  over  t  yields 

p  p 

AAQ  +  QAAT  =  £  *i(AiQ  +  Q*i)  <  2  *1*4  +  <3^1, 

tsl  »=1 

which  yields  (3.1)  with  fJ(-)  =  X?i(-)  and  U  =  Ui.  □ 

Remark  5.1.  It  is  tempting  to  prove  Proposition  5.1  by  writing 

+  QAj)  <  |  £>(*$  +  QA?)\  <  f  l |(r<(. AiQ  +  QA?)\. 

»=1  «=1  »=sl 

However,  counterexamples  show  that  the  inequality  |Mi  +  Mi\  <  |Mi|  +  |Mj|  is  not  generally  true 
for  arbitrary  symmetric  matrices  Mi,  Mj. 

Remark  5.2.  Because  of  its  simplicity  it  is  tempting  to  conjecture  that  f?i(>)  is  the  best  bound 
for  AAQ  +  QAAt  over  the  set  Ui-  To  show  that  this  is  not  the  case,  let  Q  =  ^ij,  p  =  1,  A\  = 
[o  -i]>  =  1-  Then  <ri(AiQ  +  QAj)  <  5i|Ai<?  +  QAj |  =  h,\<Ti\  <  1.  However,  it  is  also 

true  that  tri(AiQ  +  QAj)  <  8^a|  ,  |oi|  <  1.  Neither  bound,  however,  is  an  overbound  for 

the  other.  This  is  a  consequence  of  the  fact  that  the  nonnegative-definite  matrix  ordering  is  only  a 
partial  order. 

As  mentioned  above,  an  overbound  for  f?i(*)  will  also  bound  U  i. 

Lemma  5.1.  For  *  =  1, . . .  ,p,  let  /,• :  IR  -*  IR  satisfy 


/»(*)  >  |*|,  *  €  IR. 


(5.3) 


Then  the  function 

na  (Q)  =  f^SiMAiQ  +  QAj)  (5.4) 

«= 1 
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is  an  overbound  for  rti(*)  and  hence  also  bounds  Ui. 


One  particular  choice  of  /*•  satisfying  (5.3)  will  be  considered  here,  namely,  the  polynomial 

/<(*)  =  iA  +  flfV,  (5.5) 

where  fi,  is  an  arbitrary  positive  constant.  Thus  J7j(-)  has  the  following  specialization. 

Corollary  5.1.  Let  fix,  ...,fip  be  arbitrary  positive  constants.  Then  the  function 

fls(Q)  =  \  E +  X>/A)(*Q  +  QAj)'  (5-6) 

i=l  «al 

is  an*  overbound  for  f?i(*)  and  hence  also  bounds  Ux. 

Although  overbounding  Oi(-)  by  X7*(-)  results  in  a  looser  bound  for  Ux,  it  turns  out  that  fls(*) 
actually  bounds  a  set  which  is  larger  than  Ux.  Specifically,  in  place  of  Ux  consider 

Z/34{4A€lRnXn:  AA^ffiAi,  £>?/a?  <  1},  (5.7) 

isl  is  1 

where  ati . ap  are  given  positive  constants.  Note  that  (5.7)  replaces  the  rectangle  of  uncertain 

parameters  (<rlt . .  .,<rp)  by  an  ellipse.  Thus  the  set  Uj  of  matrix  perturbations  is  an  ellipse  of 
matrices  in  lRnxn  in  contrast  to  the  polytope  Ux.  Of  course,  Ui  =  U2  if  p  =  1  and  =  Si.  Again 
it  is  possible  to  take  ati  —  1  without  loss  of  generality  by  replacing  Ai  by  ct'A,.  We  again  choose  not 
to  do  this,  however.  The  following  lemma  provides  a  convenient  characterization  of  the  relationship 
between  the  rectangle  Ui  and  the  ellipse  U2. 

Proposition  5.2.  Suppose  Ui  is  defined  by  the  positive  constants  Si,...,Sp  and  let  Uj  be 
characterized  by 

at,-  =  (at5i/0i)* ,  i  =  1 . .  (5.8) 

where  a  is  defined  by 

p 

«  =  (5.9) 

isl 

and  fix,... 0P  are  arbitrary  positive  constants.  Then  U2  contains  U\.  Specifically,  the  ellipse  U2 
circumscribes  the  polytope  U\.  Furthermore,  i?3(.)  actually  bounds  U2. 

Proof.  If  |o*|  <  Si,  i  =  1,. . .  ,p,  then  it  follows  from  (5.8)  that 

!>*?/*  <  a ~l^PiSi  =  1. 
i=l  «'=1  i=l 
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If,  in  addition,  |<r»j  =  Si,  *  =  1, . . .  ,p,  then  ^»*/°?  =  1»  which  corresponds  to  a  point  on  the 
boundary  of  the  ellipse.  To  show  that  /73(-)  actually  bounds  Ut  note  that 

0  <  X)  [ a (a* *»/“»' Kn  -  (a</a*)(A<Q  +  QA?)]J 

»=i 

=  *  J>?/a?)  +  a"1  £  a?(AQ  +  QAj)2  -  ( AAQ  +  QAAr). 

«=i  «=i 

Since  12<=iaf/ai  <  1  in  ft*,  it  follows  that 

4A<3  +  Q4AT  <  *  Jn  +  a-1  J>?(AiQ  +  QA?)2. 

♦=i 

Utilizing  (5.8)  and  (5.9)  to  substitute  for  a  and  a*  yields  (3.1)  with  !?(•)  =  173(-)  and  U  =  Ut-  □ 

Proposition  5.2  shows  that  each  choice  of  constants  0i,  ■  ■  ■  ,flp  >0  leads  to  a  particular  ellipse 
Ut  which  contains  the  polytope  Ui.  Furthermore,  i?3(-),  which  by  Corollary  5.1  bounds  Ui,  actually 
bounds  the  larger  set  Ut-  For  convenience,  we  now  dispense  with  the  constants  /3lt...,Pp  which 
relate  the  rectangle  U\  to  the  ellipse  Ut  and  we  characterize  J?s(*)  entirely  in  terms  of  ai, . . .  ,ap. 

Corollary  5.2.  Let  a  be  an  arbitrary  positive  constant.  Then  the  function 

n*(Q)  =  $  In  +  cT1  £>?(*<?  +  QA?)2  (5.10) 

•=1 

bounds  ft*. 

Remark  5.3.  Within  the  context  of  Corollary  5.2,  the  positive  constant  a  plays  no  role  in 
defining  the  set  Ut,  although  f?4(*)  is  guaranteed  to  bound  Ut  for  all  choices  of  a.  It  can  be 
expected,  however,  that  certain  choices  of  a  provide  better  bounds  than  other  choices.  This  will 
be  seen  by  example  in  Section  10. 

5.2  Type  II  Bounds 

We  now  consider  additional  bounds  for  U  which  exploit  the  structure  of  Q.  For  these  bounds 
the  natural  uncertainty  set  is  given  by  ft*. 

Proposition  5.3.  Let  a  be  an  arbitrary  positive  number  and,  for  each  Q  €  I Nn,  let  Q i  € 
IRnXm  and  Qt  €  JRmxn  satisfy 

Q  =  QiQ3-  (5.11) 
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Then  the  function 


ns(Q)  4  aQjQt  +  a-'Y^ctAiQiQ? A?  (5.12) 

i=l 

bounds  U  j. 

Proof.  Note  that 

0<E  [(a*<r*/a»')<?a  ~  [cti/o^)AiQi]  [(o^Oi/ai)Ql  -  (ciE</a*)A1i<3i]T 

isl 

=  a'52{?i/(*i)QlQt  +  “-l  Y1  aiAiQiQiA?  -  a4{AQ  +  QA J), 

*=i  »=i  »=i 

which,  since  ££=1  of /a?  <  1,  yields  (3.1)  with  /?(•)  =  J ?5(-)  and  &  =  lf2.  □ 

We  consider  three  specializations  of  ftg(-).  Specifically,  we  set  m  =  n  and  define 


Ql  —  Qi  Q  2  —  Ini 

(5.13) 

Qi=Q2=Q*, 

(5.14) 

Q 1  =  Int  Qi  =  Q  ■ 

(5.15) 

Corollary  5.3.  Let  a  be  an  arbitrary  positive  number.  Then  the  functions 

n<{Q)  4  aln  +  a-'  ^aiAQW, 

»=  l 

(5.16) 

n7(Q)  =  aQ  +  a~l  ^  a}AiQA?, 

i=l 

(5.17) 

C2i(Q)  4  aQ3  +  a'1  ^ 

isl 

(5.18) 

bound  Ui. 

Remark  5.3.  Note  that  the  term  A*Q3Aj  appearing  in  fle(')  also  appears  in  1?4(-).  Further¬ 
more,  both  n4(-)  and  17a  (•)  involve  a  term  proportional  to  I„.  Despite  these  similarities,  neither 

bound  04(-)  not  /?«(•)  is  an  overbound  for  the  other. 


Remark  5.4.  The  bound  /?r(*)  given  by  (5.17)  has  the  distinction  that  it  is  linear  in  Q.  This 
bound  was  originally  studied  in  [23,27]  for  systems  with  multiplicative  white  noise  and  was  shown 
to  yield  robust  stability  and  performance  in  [33,35].  A  similar  bound  was  studied  in  [34]. 
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Remark  5.5.  Using  (5.11)  additional  bounds  can  be  developed.  For  example,  by  setting 


Qi  =  Q *,  =  (5.19) 

Os(Q)  becomes 

p 

n9(Q)  =  agi  +  a"1  £  a?A<Q*  A?.  (5.20) 

«=i 

Remark  5.6.  When  p  =  1  and  a  is  replaced  by  aon,  J?7(-)  becomes 

^t(Q)  =  +  ct-'AiQA?}. 

Utilizing  a  sum  of  such  terms  with  a<  =  Si  can  be  used  to  bound  the  smaller  rectangul^  set  Ui- 
Similar  remarks  apply  to  rte(*)>  ^s(’),  and  /?9(-). 

5.3  Type  HI  Bounds 

We  now  consider  bounds  which  exploit  the  structure  of  AA  itself.  It  turns  out  that  these 
bounds  permit  consideration  of  an  uncertainty  set  U  which  is  larger  than  Zlj.  Specifically,  define 

Ui  =  {AAe  m.nxn  :  AA  -  MN,  MMt<D,  NtN<E},  (5.21) 

where  M  €  IRnXr  and  N  €  IRrXn  are  uncertain  matrices,  r  is  an  arbitrary  positive  integer,  and 
D,E  €  INn  are  given  uncertainty  bounds.  The  bound  J7io(-)  for  Us  is  given  by  the  following  result. 

Proposition  5.4.  Let  a  be  an  arbitrary  positive  constant.  Then  the  function 

/?io(g)  =  a~lD  +  aQEQ  (5.22) 

bounds  Us. 

Proof.  Note  that 

0  <  [a -*Af  -  a*gNT][cr*  Af  -  a*gN'T]T 
=  a~lMMr  +  aQNTNQ  -  [MNQ  +  g(MJV)T] 

<  a~lD  +  aQEQ  -  (AAQ  +  QAAT), 
which  yields  (3.1)  with  /?(*)  =  l?io(')  and  U  =  Us-  □ 

Remark  5.7.  The  bound  flio(-)  was  developed  independently  in  [29]  for  robust  analysis  and  in 
[25,28]  for  robust  full-state  feedback.  Applications  to  fixed-order  dynamic  compensation  are  given 
in  [36]. 
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Remark  5.8.  Without  loss  of  generality  we  can  set  a  =  1  in  (5.22)  by  replacing  D  and  E  by 
a-1D  and  aE,  respectively.  Again  for  clarity  we  have  chosen  not  to  employ  this  normalization. 

Note  that  is  an  overbound  for  /7g(*)  when  D  and  E  are  chosen  to  satisfy 

p 

<  D,  In<E.  (5.23) 

•si 

Hence,  in  this  case  /Jio(-)  necessarily  bounds  U2.  As  in  the  case  of  i?s(*)  overbounding  /7i(-),  we 
should  not  be  surprised  to  find  that  /?io(‘)  actually  bounds  a  set  larger  than  U2.  Indeed,  we  now 
show  that  U2  is  actually  a  very  special  subset  of  Us  when  D  and  E  defining  Us  satisfy  (5.23). 

Proposition  5.5.  Suppose  D  and  E  satisfy  (5.23).  Then  Ui  is  &  subset  of  Us  and  thus  the 
bound  f?io(*)  for  Us  also  bounds  U2. 


Proof.  If  AA  G  Ui  then  AA  —  aiAit  where  ai  I ai  ^  1.  Alternatively,  we  can 
write  AA  =  MN ,  where  r  =  pn  and 


M  [otjAi . . .  cipAp], 


N  = 


(tri/ajln 


(5.24) 


L  (<rp/op)/„  J 

Note  that  with  D  and  E  satisfying  (5.23)  and  M  and  N  defined  by  (5.24)  it  follows  that  MMT  <  D 
and  NrN  <  E.  Thus  AA  €  Us.  □ 


The  following  result  provides  general  conditions  under  which  f710(*)  bounds  U2. 

Proposition  5.6.  Suppose  Ai  =  DiEi,  i  =  1, . . .  ,p,  where  €  IRnXn<  and  Ei  €  IRn,  Xn, 
and  suppose  that 

X)  <$DiDj  <D,  £  E?Ei  ^  E-  (5.25) 

»=X  »=1 

Then  Ui  is  a  subset  of  Us  and  thus  the  bound  /?l0(-)  for  Us  also  bounds  U2. 

Proof.  The  result  follows  as  in  the  proof  Proposition  5.5.  □ 


Remark  5.9.  When  p  —  1,  D  =  a \D2Dj  and  E  =  Ef  E\,  it  is  convenient  to  replace  a  by 
aai  so  that  /2io(*)  becomes 


n[o(Q)  =  otl[a~lDlDj  +aQE?E1Q}. 


(5.26) 


In  certain  situations  it  is  desirable  to  consider  subsets  of 
define 


Us  of  special  structure.  For  example, 


U*  =  {AA€  JR"*":  AA  =  DqMNEq,  D0MMtD^<D,  E^NtNE0  <  E), 


where  Do  €  lRnXn*  and  Eq  E  IR"*  x“  are  known  matrices  denoting  the  structure  of  the  uncertainty, 
and  M  E  IR"‘Xr  and  N  E  IRrX"a  are  uncertain  matrices.  Finer  structure  can  be  included  within 
Ui  by  replacing  DoMNEo  by  a  sum  of  terms  DiMyNiEi,  where  Di,  Ei  are  known  and  Mi,  Ni  are 
uncertain  ([29]).  Note,  however,  that  even  though  U4  is  a  proper  subset  of  Ui,  the  form  of  the 
bound  HioC*)  does  not  change.  Thus  such  refinements  render  the  bound  tfio(')  conservative  with 
respect  to  since  the  larger  uncertainty  set  Us  is  actually  being  bounded. 

6.  Robust  Stability  and  Performance  via  Modified  Lyapunov  Equations 

We  now  combine  the  principal  results  of  Sections  3,  4  and  5  to  obtain  a  series  of  conditions 
guaranteeing  robust  stability  and  performance.  In  particular,  we  focus  on  bounds  /7i,J?4,/?6,/?7, 
and  Oiq.  For  simplicity  we  shall  frequently  assume  that  V  is  positive  definite  so  that  (3.3)  is 
satisfied.  In  this  case  it  follows  that  the  solution  Q  of  (3.2)  is  positive  definite.  Our  first  result  is  a 
corollary  of  Theorem  3.1  with  17(-)  =  J?i(-)  and  U  =  U\. 

Theorem  6.1.  Let  V  E  DP" ,  61 . 6P  >0,  and  suppose  there  exists  Q  E  IP"  satisfying 

p 

0  =  AQ  +  QAr  +  £  Si\AiQ  +  +  V. .  (MLE1) 

»=i 

Then  A  +  A  A  is  asymptotically  stable  for  all  A  A  Elli,  and 

MUi)  <  tr  QR,  (6.1) 

MUi)  <  A m„{QR).  (6.2) 

For  the  next  result  define 

Aa  =  A  +  f  /„  (6.3) 

and 

7t  =  a</a,  *  =  l,...,p.  (6.4) 

Setting  n(-)  =  /74(-),r?e(*),r?7(  )  and  U  =  U3  yields  the  following  corollary  of  Theorem  3.1. 

Theorem  6.2.  Let  V  E  IP",  a,ai,. . .  ,ap  >  0,  and  suppose  there  exists  Q  E  IP"  satisfying 
either 

p 

0  =  AQ  +  QAt  +  ^(AiQ  +  QAj)3  +  *In  +  V,  (MLE2) 

«= 1 
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(MLE3) 


0  =  AQ  +  QAt  +  '£tliAiQ*A?  +  aln  +  V, 

»=i 

or 

p 

0  =  AaQ  +  QAl  +  '£t'nAiQA7  +  V. 

*=  l 

Then  A  +  AA  is  asymptotically  stable  for  all  A  A  €  U  j,  and 

Ss(Ut)<  t rQR, 

MUJ  <  \m*x{QR). 


(MLE4) 

(6.5) 

(6.6) 


Next  we  set  /?(•)  =  flio(0  and  U  =  Ua- 

Theorem  6.3.  Let  V  €  TPn,D  €  IN",  and  E  e  INn,  and  suppose  there  exists  Q  G  IPn 
satisfying 

0  =  AQ  +  QAr  +  aQEQ  +  a~lD  +  V.  (MLE5) 

Then  A  +  A  A  is  asymptotically  stable  for  all  A  A  €  Ua,  and 

MUa)  <  tr  QR,  (6.7) 

MUa)  <  A mmx{QR).  (6.8) 

Additional  sufficient  conditions  can  be  obtained  by  considering  “mixed”  bounds.  That  is,  one 
can  construct  modified  Lyapunov  equations  by  combining  two  or  more  different  bounds.  Although 
mixed  bounds  will  not  be  considered  further  in  this  paper,  we  present  one  ouch  result  for  illustrative 
purposes. 

Theorem  6.4.  Let  V  €  IP",  Si, . . . ,  Sp  >  0,  D  €  IN",  and  E  €  IN",  and  suppose  there  exists 
Q  €  IP"  satisfying 

p 

0  =  AQ  +  QAT +  '%26i\AiQ  +  QAj\+  aQEQ  +  a^D  +  V.  (MLE1,5) 

»=i 

Then  A  +  A  A  is  asymptotically  stable  for  all  A  A  GUi  +  Ua,  and 

«/s(tti  +  Us)<  tr  QR,  (6.9) 

MUi  +  Ua)<Xm%x(QR).  (6.10) 
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As  noted  previously,  the  bound  d(»)  can  readily  be  constructed  by  replacing  AA  by  AAT  in  the 
definitions  of /?i(*)  through  /?io(‘).  Denote  these  bounds  by  Ax(*)  through  Aio(0>  respectively.  For 
illustration  we  state  the  dual  of  Theorem  6.1  involving  Ai(*).  The  dual  versions  of  MLE1  through 
MLE5  will  be  denoted  by  MLEDl  through  MLED5. 

Theorem  6.5.  Let  R  €  IP",  Si,...,Sp  >  0  and  suppose  there  exists  P  G  IPn  satisfying 

p 

0  =  A^P  +  PA+^SAAiP+PM  +  R-  (MLEDl) 

»=i 

Then  A  +  A  A  is  asymptotically  stable  for  all  A  A  E  Ui,  and 

•Wi)  <  tr  PV,  (6.11) 

iD(Hi)  <  An„(PV).  (6.12) 


It  is  reasonable  to  expect  that  the  sufficient  conditions  given  by  Theorems  3.1  and  4.1  are 
generally  different.  For  example,  the  modified  Lyapunov  equations  and  their  duals  need  not  both 
possess  a  solution,  while  the  bounds  tr  QR  and  tr  PV  need  not  be  equal.  An  exception  is  the  case 
in  which  fl(>)  =  DzO)  and  A(-)  =  At(-).  Note  that  the  dual  of  MLE4  is  given  by 

p 

0  =  AlP  +  PAa  +  £  liAjPAi  +  V.  (MLED4) 

•si 


Proposition  6.1.  Let  a1} . . . ,  ap  >  0  and  assume  there  exist  Q,P  E  INn  satisfying  MLE4  and 
MLED4,  respectively.  Then 


tr  QR  =  tr  PV. 


(6.13) 


Proof.  Note  that 

tr  QR  =  -tr  Q(ATaP+PAa  +  £7<A?PA<) 

*=i 

=  -tr  P{AaQ  +  QAl  +  '52'nAiQAj) 

»=i 

=  tr  PV.  □ 


Remark  6.1.  By  setting  !?(•)  =  1?7(-)  and  d(-)  =  M(’)  it  follows  from  (4.14)  that 

p  p 

tr  Q0(aP+^2'uAjPAi)  =  tr  P0(aQ  +  ^7*>L<?^)- 

i=l  i-1 


(6.14) 
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7.  Existence,  Uniqueness,  and  Monotonicity  of  Solutions  to  the  Modified  Lyapunov 
Equations 

It  is  important  to  stress  that  the  sufficient  conditions  for  robustness  given  by  Theorems  6. 1-6.5 
assume  only  that  there  exist  nonnegative-definite  solutions  Q,  P  satisfying  the  modified  Lyapunov 
equations.  Indeed,  no  explicit  assumptions  on  the  problem  data  A,V,R ,  and  U  were  utilized  for 
assuring  robust  stability  and  performance.  In  applying  Theorems  6. 1-6. 5  to  specific  problems  it  thus 
suffices  to  show  that  a  nonnegative-definite  solution  Q  exists  in  order  to  obtain  robust  stability, 
while,  for  robust  performance,  the  bounds  (6.1),  (6.2),  (6.5)-(6.8)  require  explicit  knowledge  of 
Q.  Thus,  any  computational  method  which  yields  a  nonnegative-definite  solution  will  suffice  to 
guarantee  both  robust  stability  and  performance. 

Before  considering  the  numerical  solution  of  the  modified  Lyapunov  equations,  several  relevant 
issues  require  discussion.  For  example,  before  seeking  to  compute  solutions  to  MLE1-MLE5  it 
would  be  desirable  to  determine  a  priori  whether  these  equations  actually  possess  nonnegative- 
definite  solutions.  For  example,  it  may  be  useful  to  obtain  sufficient  and/or  necessary  conditions 
for  the  existence  of  nonnegative-definite  solutions.  Thus,  if  the  sufficient  conditions  are  satisfied 
then  existence  (and  hence  robustness)  is  assured,  while  if  the  necessary  conditions  are  not  satisfied 
then  existence  is  ruled  out.  If,  on  the  other  hand,  either  the  sufficient  conditions  are  not  satisfied  or 
the  necessary  conditions  are  satisfied,  then  nothing  can  be  surmised.  Finally,  such  conditions  need 
to  be  easily  verifiable  and  reasonably  nonconservative  since  otherwise  it  would  be  more  prudent  to 
attempt  to  numerically  solve  the  modified  Lyapunov  equation  itself. 

It  is  quite  possible  that  at  least  some  of  the  modified  Lyapunov  equations  possess  multiple 
nonnegative-definite  solutions.  In  this  case  one  may  seek  the  minimal  solution  (i.e.,  the  smallest 
with  respect  to  the  nonnegative-definite  matrix  ordering)  in  order  to  minimize  the  performance 
bounds.  If  multiple  solutions  exist,  none  of  which  is  minimal,  then  the  best  bound  would  depend 
upon  the  matrix  R. 

Since  the  matrix  Q  determines  the  performance  bound,  it  is  reasonable  to  expect  that  Q  is 
monotonic  in  U.  That  is,  if  U  decreases  in  size,  then  the  solution  Q  is  more  likely  to  exist  while 
decreasing  in  the  nonnegative-definite  matrix  ordering.  For  example,  consider  U[  characterized  by 
S'it  where  6[  <  Si,  i  =  1, . . .  ,p.  Then  one  might  expect  Q'  <  Q  where  Q'  is  the  solution  to  MLEl 
with  8i  replaced  by  5(.  Finally,  monotonicity  with  respect  to  V  should  also  be  expected. 


Because  of  linearity,  the  analysis  of  bound  f?7(*)  is  simplest  and  it  is  possible  to  obtain  necessary 
and  sufficient  conditions  for  the  existence  of  solutions  to  MLE4.  The  basic  tool  required  is  the 
Kronecker  matrix  algebra  ([42]).  For  convenience,  define 

p 

A^AaQAa  +  ^tiAiQAi.  (7.1) 

i=l 

Proposition  7.1.  If  V  e  IN"  and  A  is  asymptotically  stable,  then  there  exists  a  unique  n  x  nQ 
satisfying  MLE4,  and  Q  >  0.  Conversely,  if  for  all  V  €  IN"  there  exists  Q  >  0  satisfying  MLE4, 
then  A  is  asymptotically  stable. 

Proof.  Since  MLE4  is  equivalent  to 

Q  =  -vec-1[^-1vec  V],  (7.2) 

existence  and  uniqueness  hold.  Here,  vec  and  vec-1  denote  the  column-stacking  operation  ([42]) 
and  its  inverse.  To  prove  that  Q  is  nonnegative  definite,  we  rewrite  (7.2)  as 

Q  =  f  vec~l[cAtvec  V\dt  (7.3) 

Jo 

and  show  that  the  integrand  is  nonnegative-definite  for  all  t  €  [0,oo).  [Note  that  the  following 
argument  does  not  require  that  A  be  stable.]  Using  the  exponential  product  formula,  the  exponential 
in  (7.3)  can  be  written  as 

*At  =  jfiL  {  CXP  £' *^a  ®  Aa^  *XP  tfc  ®  ^)t]  }  .  (7.4) 

i=l 

For  convenience,  let  S  and  N  be  r  x  r  matrices  with  N  >  0.  Since  (see  [42]) 

vec-1  [(5  ®  S)vec  N]  =  SNST  >  0  (7.5) 

and 

(S*®S*)(S®S)  =  Sfe+1®Sfc+I,  (7.6) 

it  follows  that 

OO 

vec-1[e5®svec  N]  =  ^,{k\)~1SkNSkT  >  0.  (7.7) 

k=o 

Furthermore, 

vec-1[e50Svec  iV]  =  vec-1[(es  ®  e5)vec  iV]  =  es NesT  >  0.  (7.8) 
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Applying  (7.7)  and  (7.8)  alternately  with  (7.4) .and  using  induction  on  k  it  follows  that  the  integrand 
of  (7.3)  is  nonnegative  definite.  To  prove  the  converse,  note  that  it  follows  from  MLE4  that  Q 
satisfies 

Q  =  vec-1[eJ,*vec  Q]+  j  vec-1[e**vec  V]ds,  te[0,oo).  (7.9) 

Jo 

Since  the  integral  term  on  the  right  hand  side  of  (7.9)  is  nonnegative  definite,  is  bounded  from 
above  by  Q,  and  V  G  INn  is  arbitrary,  it  follows  that  A  is  asymptotically  stable.  □ 

We  now  show  that  if  A  is  asymptotically  stable  then  actually  Aa  is  asymptotically  stable.  This 
shows  that  the  assumption  that  A  is  asymptotically  stable  is  consistent  with  the  original  hypothesis 
that  A  is  asymptotically  stable. 

Proposition  7.2.  Assume  A  is  asymptotically  stable,  let  G  [0,a»],  i  =  1  ,...,p,  and  define 

p 

A'  =  Aa  ©  Aa  +  ®  Ai. 

♦=i 

Then  A1  is  also  asymptotically  stable.  In  particular,  Aa  and  A  are  asymptotically  stable. 

Proof.  Let  V  G  IN”  and  let  Q  be  the  unique,  nonnegative-definite  solution  of  MLE4.  Equiva¬ 
lently,  Q  satisfies 

0  =  AaQ  +  QAl  +  £(c?/a)AiQAj  +  V\ 

»=i 

where 

V  =  £>-■(«?  -  »?)AQAj  +  V. 

«=x 

Since  V*  €  INn,  the  stability  of  A'  now  follows  from  the  converse  of  Proposition  7.1.  Finally,  if 
V  €  IP"  then  Y^i=i{a? la)A%QAj  +  V'  is  positive  definite  and  it  follows  from  Lemma  12.2  of  [39] 
that  Aa,  and  hence  A,  is  asymptotically  stable.  □ 

Hence  it  follows  from  Proposition  7.2  that  a  necessary  condition  for  A  to  be  asymptotically 
stable  is  that 

a  <  2  max  Re  A *(A).  (7.10) 

We  now  have  the  following  monotonicity  result. 

Proposition  7.3.  Let  U'2  C  Uj,  where  U'3  is  defined  as  in  (5.7)  with  a,  replaced  by  € 
[0, 04],  1  =  1,... ,p.  Furthermore,  let  V  €  IP",  assume  A  is  asymptotically  stable,  and  let  Q  €  INn 
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satisfy  MLE4.  Then  there  exists  Q'  €  INn  satisfying 


p 


0  =  AaQ'  +  Q'Al  +  j>J*/a)A<g'A?  +  V, 

»=  l 

(7.11) 

and,  furthermore, 

Q'  <  Q- 

(7.12) 

Consequently, 

tr  Q'R  <  tr  QR, 

(7.13) 

<  Amax(gi2). 

(7.14) 

Proof.  Subtracting  (7.11)  from  MLE4  yields 

o  =  AM  -  Q')  +  (<3  -  Q')Al  +  -  O') AT  +  V\ 

«=1 

where  V'  is  defined  in  the  proof  of  Proposition  7.2.  Since,  by  the  converse  of  Proposition  7.1,  A'  is 
asymptotically  stable,  Q  —  Q1  >  0,  which  yields  (7.12)  and  thus  (7.13)  and  (7.14).  □ 

Returning  now  to  the  existence  question,  Proposition  7.1  shows  that  a  solution  to  MLE4  exists 
so  long  as  ai, . .  .ap  are  sufficiently  small  that  A  remains  stable  for  some  a  >  0.  To  this  end  one 
can  treat  this  as  a  stability  perturbation  problem  and  apply  results  from  [3].  Within  our  modified 
Lyapunov  equation  approach  we  have  the  following  related  result.  For  this  and  the  following  result 
let  ||  •  ||  denote  an  arbitrary  vector  norm  and  the  corresponding  induced  matrix  norm. 

Proposition  7.4.  If 

IK-4  ©  A)~1(al„a  +  a"1  £  a?  A*  ®  A<)||  <  1,  (7.15) 

»=i 

then  for  all  V  6  lNn  there  exists  Q  €  IN"  satisfying  MLE4  and  hence  A  is  asymptotically  stable. 
Proof.  Define  {Qfc}*l0  w^ere  Qo  satisfies  (3.14)  and  Qk+i  satisfies 

0  =  +  Qk+iAr  +  n7{Qk)  +  V. 

Note  that  Q*  >  0,  Jb  =  1,2, _ Hence  it  follows  that 

vec  Qk+i  -  vec  Qk  =  -(A©  A)-1[vec  n7{Qk)  -  vec  /^(Q*-!)] 
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and  thus 


p 

!|vec  <3*+i  -  vec  (3*11  <  j|(A  ©  j4)-1(a/„a  +  a-1  ^  a* A,-  ®  A,)||||vec  Qk  -  vec  <3*_i||. 

»=i 

Using  (7.15)  it  follows  that  Q  =  lim*_oo  Qk  exists.  Thus  <3  >  0  and  satisfies  MLE4.  Finally,  by 
the  converse  of  Proposition  7.1,  A  is  asymptotically  stable.  □ 

Since  MLE5  is  nonlinear  a  slightly  different  approach  is  required  for  existence.  For  the  following 
result  let  k,0  >  0  satisfy 

||eAt||  <  ke'0it  t  >  0,  (7.16) 

where  ||  •  ||  denotes  an  arbitrary  submultiplicative  matrix  norm,  and  define  p  =  2(3 /k*. 
Proposition  7.5.  Suppose  V  6  INn  and 


4a||E!|||a-1D  +  V||<p1. 


(7.17) 


Then  there  exists  Q  €  INn  satisfying  MLE5. 

Proof.  Consider  the  sequence  {<3*}*10  where  <3o  satisfies  (3.14)  and  Qk+ 1  is  given  by 

0  =  AQk+l  +  Qk+iAr  +  o  QkEQk  +  a.~lD  +  V. 

Clearly,  Qk  >  0,  k  =  0, 1 . Next  we  have 

Qk+i=  [  eAt[o  QkEQk  +  cTlD  +  V\eATtdt  (7.18) 

JO 

which  yields 


Similarly,  we  obtain 

Now  suppose  that 


||<3o||  + 


llQfcll  <  2p-1||a_1Z?  +  V||. 

Then  (7.17)  and  (7.19)  imply 

|jQfc+i||  <  ap-^lEH [2p-'\\a-lD  +  V||]’  +  p^Wa^D  +  V\\ 
<  2p~l\\a~1D  +  V||. 


(7.19) 
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Thus  HQ^I  <  2p-x\\a~xD  +  V\\,  k  =  0, 1, . . ..  Next,  (7.18)  yields 

Qh+ 1  -Q„  =  cc  eM[QhEQh  -  Qk-iEQ^e^dt 
Jo 

=  a[  eAt[Q,,E(Qk  -  Qfc_x)  +  ( Qk  -  Q^EQ^e^dt 
Jo 

and  thus 

I!<3*+1  -  Qk II  <  ap-^l^lldlQfcll  +  ||<5*-x||)||Qfc  -  gfc-i|| 

<  4ap-J||E||||a-1D  +  V||||g*  - 

<*\\Qk-Qk+i\\, 

where  e  =  4ap~,||jE||||a-1D+V||.  Since  by  (7.16)  e  <  1,  limfc_00  Qk  exists,  is  nonnegative  definite, 
and  satisfies  MLE5.  □ 

8.  Additional  Upper  Bounds  via  Recursive  Substitution 

In  this  section  we  obtain  additional  upper  bounds  for  Js(U)  and  Jj>(U)  by  utilizing  a  recursive 
substitution  technique.  The  main  idea  involves  rewriting  (2.7)  as 

Qaa  =  ~vec-1{(A©  A)-1(AA©  AA)  vec  Qaa}  +Qo  (8.1) 

and  substituting  this  expression  into  the  terms  AAQaa  +  QaaAAt  appearing  in  (2.7).  This 
technique  yields  an  equation  which  is,  as  expected,  equivalent  to  (2.7)  but  which  permits  the 
development  of  additional  bounds.  As  will  be  seen,  the  ability  to  develop  new  bounds  exploits 
the  fact  that  the  substitution  technique  leads  to  terms  which  are  quadratic  in  AA.  We  begin  the 
development  with  the  following  technical  result  which  does  not  require  the  assumption  that  A  is 
asymptotically  stable. 

Proposition  8.1.  Suppose  A  ©  A  is  invertible  and  let  AA  €  IRnXn.  If  Qaa  satisfies  (2.7) 
then  Qaa  also  satisfies 

0  =  AQaa  +  QaaAt  -  vec-1[(AA©  4A)(Affi  A)-1(AAffi  4A)vec  Qaa 

(8.2) 

+  (AA  ©  AA)(A  ©  A)-1vec  V ]  +  V. 

Conversely,  if  Qaa  satisfies  (8.2)  and  (A  -  AA)  ©  (A  -  AA)  is  invertible,  then  Qaa  also  satisfies 
(2.7). 

Proof.  To  obtain  (8.2)  substitute  (8.1)  into  (2.7)  as  noted  above.  Conversely,  adding  the  zero 
term  (AA  ©  AA)(A  ©  A)-1(A  ©  A)vec  Qaa  ~  (■AA  ©  AA)vec  Qaa  to  (8.2),  it  follows  that  (8.2) 
can  be  written  as 

0  =  [(A  -  AA)  ©  (A  -  A  A)]  (A  ©  A)”1  [(A  +  A  A)  ©  (A  +  4  A)  vec  Q  a  a  +  vec  V] , 
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which,  under  the  invertibility  assumption,  implies  that  Qaa  satisfies  (2.7).  □ 

The  following  result  is  analogous  to  Theorem  3.1. 

Theorem  8.1.  Suppose  U  is  symmetric,  let  I70  €  INn  satisfy 

AAQq  +  Q0AAt  <nQ,  AAEU ,  (8.3) 

where  Qq  satisfies  (3.14),  let  Cl :  INn  — *  INn  satisfy 

— vec-1  [(AA  ©  AA)(A  ©  A)-1(AA  ©  AA)vec  Q]  <  f?(Q),  AA  E  U,  Q  E  INn,  (8.4) 
and  suppose  there  exists  Q  E  IN"  satisfying 

0  =  AQ  +  QAT +n{Q)  +  C20+V.  (8.5) 

Then 

^A  +  AA,  {X7(Q)  +  vec-1[(AA©  AA^Affi-Aj-^AA©  A<4)vec  Q]  +/7o+'Vr}^ 
is  stabilizable,  A  A  Ell, 

if  and  only  if 

A  +  AA  is  asymptotically  stable,  A  A  €  U. 

In  this  case, 

Qaa  <  Q,  AA  E  U, 

where  Qaa  satisfies  (2.7),  and 

Js(U)  <  tr  QR, 

MU)  <  ^mtx  (Q*Y 

Proof.  The  equivalence  of  (8.6)  and  (8.7)  follows  from  (8.5)  as  in  the  proof  of  Theorem  3.1. 
Next  (8.8)  follows  by  comparing  (8.5)  and  (8.2)  while  using  (8.3)  and  (8.4).  Since  U  is  assumed  to  be 
symmetric,  it  follows  that  A-AA  is  asymptotically  stable,  AA  E  U,  and  hence  (A-^A)©(A- AA) 
is  invertible,  AA  E  U.  Thus,  the  converse  of  Proposition  8.1  implies  that  Qaa  satisfying  (8.2)  also 
satisfies  (2.7).  Thus,  the  bound  (8.8)  can  be  used  to  obtain  (8.9)  and  (8.10).  □ 

The  principal  difference  between  (8.4)  and  (3.1)  is  that  A  A  appears  linearly  in  (3.1)  while  it 
appears  quadratically  in  (8.4).  By  exploiting  this  structure  we  can  obtain  new  bounds  for  Qaa- 


(8.6) 

(8.7) 

(8.8) 

(8.9) 

(8.10) 
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To  simplify  matters,  we  now  consider  the  bound  in  (8.4)  in  two  special  cases.  In  the  first  case  we 
set  U  =  Ui  and  p  =  1  so  that  A  A  =  <ti  AXt  \<ri\  <  Sx.  In  this  case  (8.4)  becomes 

-<rfvec-1[(A1©A1)(A©A)-1(Ai©,A1)vecg]  <17(Q),  \vx\  <  Su  Q  €  INn.  (8.11) 

One  choice  of  !?(•)  which  immediately  suggests  itself  can  be  obtained  by  defining  the  matrix  function 
j  •  |+  on  the  set  of  symmetric  matrices  by 

|S|+±*(S+|S|),  (8.12) 

which  effectively  replaces  the  negative  eigenvalues  of  S  by  zeros.  We  shall  thus  utilize  the  fact  that 

<r?S  <  *?|S|+,  M  <  Su  (8.13) 

for  all  symmetric  S. 

Corollary  8.1.  Let  V  €  IP",  U  —  Ux,  p  =  1,  let  Dq  €  INn  satisfy  (8.3),  and  suppose  there 
exists  Q  €  IN"  satisfying 

0  *  AQ  +  QAt  +  5? |  -  vec-1  [(Ax  ©  Ai)(A  ©  A)”l(Ai  ©  Aj)vec  Q]  |+  + 1?0  +  V.  (8.14) 

Then  (8.7)-(8.10)  are  satisfied. 

For  the  next  specialization  we  shall  assume  that 

(AA)A  =  A(AA),  AA  €  U,  (8.15) 

which  holds,  for  example,  for  modal  systems  with  frequency  uncertainty  (see  Section  10).  It  thus 
follows  that  (A©  A)~l(AA  ©  A  A)  =  {AA  ©  AA){A  ©  A)-1  and  thus  (8.4)  can  be  rewritten  as 

AA*Q  +  2AAQAAT +  <$AAir  <fi{Q),  AA  €  IN,  Q  €  INn,  (8.16) 

where  Q  €  INn  satisfies 

0  =  AQ  +  QAt  +  Q.  (8.17) 

Assuming  in  addition  to  (8.15)  that  AA  =  e'lAi,  |<xi |  <  Si,  (8.14)  becomes 

0  =  AQ  +  QAt  +  6\\A\Q  +  2AiQAj  +  gA;T|+  +n0  +  V.  (8.18) 
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Remark  8.1.  It  is  interesting  to  note  that  the  left  hand  side  of  (8.16)  is  essentially  of  the  same 
form  as  Specifically,  the  term  AA^Q+QAA17  is  analogous  to  aQ  while  2AAQAA7  is  similar 
to  a-1  £f=1  a^AiQAj  appearing  in  fM*).  The  form  of  the  left  hand  side  of  (8.16)  is  also  of  interest 
since  it  is  similar  to  terms  which  arise  from  a  multiplicative  white  noise  model  with  a  Stratonovich 
correction.  Specifically,  while  the  term  AAQAA iT  arises  from  an  Ito  model  ([33]),  the  new  terms 
\AA 1  can  be  viewed  as  a  correction  to  the  nominal  A  due  to  the  Stratonovich  interpretation 
of  stochastic  integration  ([43]).  These  terms  have  interesting  ramifications  in  designing  robust 
controllers  for  flexible  structures  ([23]). 

9.  An  Alternative  Approach  Yielding  Upper  and  Lower  Bounds 

In  this  section  we  develop  a  variation  on  the  results  of  Section  3  which  has  the  additional  benefit 
of  yielding  both  upper  and  lower  performance  bounds.  The  basic  approach  was  suggested  by  results 
obtained  in  [44].  To  simplify  the  presentation  we  assume  that  if  A  A  €  U  then  -AA  6  U.  This 
symmetry  assumption  of  course  holds  for  all  of  the  uncertainty  sets  considered  in  previous  sections. 
The  underlying  idea  involves  bounding  the  deviation  of  Qaa  from  Q0  rather  than  bounding  Qaa 
directly. 

Theorem  9.1.  Let  170  e  IN'*  satisfy 

AAQo  +  Q0AAT  <n o,  AA  €  U,  (9.1) 

let  17:  IN’*  -*  IN'*  be  such  that  (3.1)  is  satisfied,  and  suppose  there  exists  AQ  €  IN'*  satisfying 

0  =  aaq  +  aqat+ n(AQ) +n0.  (9.2) 

Then 

(a  +  AA,  [n0  +  n(AQ)  -  ( AAAQ  +  AQAA7 )]*)  is  stabilizable,  AA  €  U,  (9.3) 
if  and  only  if 

A  +  4  A  is  asymptotically  stable,  A  A  €  U.  (9.4) 

In  this  case, 

Qo- AQ<Qaa<Qo  +  AQ,  AA  6  U,  (9.5) 

where  Qaa  is  given  by  (2.7),  and 


tr  (Q0  -  AQ)R  <  JS(U)  <  tr  (Q0  +  AQ)R, 


(9.6) 


^mtx  [(<?o-^fl)*]  <  MU)<  ^mtx  [(<Jo  +  4fi)*]. 


(9.7) 


Proof.  Define 

AQ  =  Qaa  -  Qo  (9.8) 

and  subtract  (3.14)  from  (2.7)  to  obtain 

0  =  (A  +  AA)AQ  +  AQ(A  +  AA)T  +  AAQ0  +  Q0AAr.  (9.9) 

Now  rewrite  (9.2)  as 

0  =  (A  +  AA)AQ  +  AQ(A  +  AA)r  +  C2{AQ)  -  (. AAAQ  +  AQAAT)  +  n0.  (9.10) 


Using  (9.10),  the  equivalence  of  (9.3)  and  (9.4)  is  immediate  as  in  the  proof  of  Theorem  3.1.  Next, 
subtracting  (9.9)  from  (9.10)  yields 


0  =  (A  +  AA){AQ  -  AQ)  +  {AQ  -  AQ)(A  +  AA)r  +  Cl (AQ)  -  ( AAAQ  +  AQAAT) 

+  Hq  —  (AAQo  +  Qo  AAT). 


(9.11) 


Using  (3.1)  and  (9.1)  it  follows  from  (9.11)  that 


AQ  -  AQ  >  0, 


or,  equivalently, 


Qa,:  <  Qo  +  AQ. 


To  obtain  the  lower  bound  rewrite  (9.9)  as 


(9.12) 


0  =  (A  +  AA)[-AQ)  +  (-4Q)(A  +  AA)T  -  {AAQo  +  Q0AAT).  (9.13) 

Note  that  because  of  the  assumed  symmetry  of  U,  (9.1)  holds  with  A  A  appearing  in  the  inequality 
replaced  by  —  A  A.  Hence  it  can  be  shown  similarly  that 


AQ  +  AQ>  0, 


or,  equivalently, 


Qo  -  AQ  <  Qaa- 


(9.14) 


Finally,  (9.6)  follows  immediately  from  (9.5)  while  (9.7)  is  a  consequence  of  Theorem  4.3.1  of  [40]. 

□ 
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Remark  9.1.  To  compare  the  upper  bound  in  (9.5)  with  (3.5),  rewrite  (9.2)  as 

0  =  A(Qo  +  AQ)  +  (Qo  +  AQ)AT  +  fi{AQ)  +  /?o  +  V.  (9-15) 

If  n(AQ)  +  Do  =  n(Qo  +  AQ)  then  (9.15)  has  the  same  form  as  (3.2)  and  thus  the  two  upper 
bounds  are  identical.  This  will  be  the  case,  for  example,  if  !?(•)  =  I7r(-)  and  H0  is  chosen  to  be 
nT(Qo)  since  1?7(-)  is  linear.  If,  for  example,  D{AQ)  +  f?0  <  0(Qo  +  AQ)  then  the  upper  bound 
in  (9.5)  will  be  sharper.  In  any  case  it  is  clear  that  the  individual  treatment  of  AQ  and  Qo  yields 
potentially  new  upper  bounds. 

Remark  9.2.  Theorem  9.1  does  not  guarantee  that  the  lower  bound  Qo  —  AQ  for  Qaa  is 
nonnegative  definite.  However,  Qaa  is  always  nonnegative  definite  and  thus  the  lower  bound  in 
(9.5)  may  be  of  limited  usefulness.  Nevertheless,  if  Qo  -  AQ  is  indefinite  then,  depending  on  R, 
the  lower  bounds  in  (9.6)  and  (9.7)  may  still  be  positive  and  thus  be  meaningful  lower  bounds. 

10.  Analytical  Examples 

In  this  section  we  consider  simple  analytical  examples  which  illustrate  the  principal  results 
of  the  paper.  These  examples  also  provide  insight  into  the  individual  characteristics  of  different 
bounds  as  a  prelude  to  numerical  examples  considered  in  the  following  section. 

To  begin  we  consider  the  simplest  possible  example.  Set  n  =  1,  A  <  0,  R  >  0,  V  >  0,  Ai  =  1, 
and  =  {AA  :  \AA\  <  S !>.  For  Si  <  -A,  Qaa  =  V/2(|A|  -  AA)  and  JS{U)  =  JD{U)  = 
RV/2(\A\  —  Si),  where  this  worst-case  performance  is  achieved  for  AA  =  Si.  Solving  MLE1  yields 
Q  =  V/2(|A|  —  Si)  which  is  a  nonconservative  result  for  both  robust  stability  and  performance. 
The  same  result  is  obtained  from  MLE4  by  setting  a  =  ai  =  S\.  To  apply  MLE5,  set  Sx  =  \/DE. 
Choosing  a  =  2£i(|A|  —  Si)EJV  again  yields  the  nonconservative  result.  Finally,  the  same  result 
follows  from  Theorem  8.1. 

* 

For  the  second  example  we  consider  nondestabilizing  uncertainty  in  the  imaginary  component 
of  an  uncertain  eigenvalue,  i.e.,  frequency  uncertainty,  in  contrast  to  uncertainty  in  the  real  part 
considered  in  the  previous  example.  Let  n  =  2,  A  =  [l*  J“„] ,  v  >  0,  <y  >  0,  V  =  R  —  /2, 
and  U  =  {AA  :  AA  =  ffiAi,  |<7i|  <  $i},  where  Ai  =  Obviously,  A  +  AA  remains 

asymptotically  stable  for  all  values  of  <xi  since  AA  affects  only  the  imaginary  part  of  the  poles  of 
AA.  The  question  then  is  whether  the  robustness  tests  are  able  to  guarantee  this  robustness.  Note 
also  that  because  of  the  choice  of  V,  Qaa  =  Q o  =  (2i/)— 1/3  for  all  AA  €  U. 
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For  this  example  we  note  that  MLEl  is  satisfied  by  Q  =  ( 2i/)~lI3  which  is  independent  of 
Sx.  Thus  MLEl  possesses  a  nonnegative-definite  solution  for  all  Si  >  0  which  shows  that  MLEl  is 
nonconservative  with  respect  to  robust  stability  and  performance.  Since  A{AA)  =  {A A) A,  it  can 
also  be  seen  that  the  same  result  holds  for  (8.18).  The  situation  is  considerably  different  for  MLE4 
and  MLE5.  To  analyze  MLE4  note  that  A  has  an  eigenvalue  —  2v  +  a  +  Si.  (This  can  be  shown  by 
diagonalizing  A  and  Ai  and  thus  A.)  Since,  by  Proposition  7.1,  A  must  be  asymptotically  stable,  we 
require  Si  <  2v.  This  is,  of  course,  an  extremely  conservative  result,  especially  when  the  damping 
v  is  small.  For  MLE5  we  can  factor  Ax  —  DiEi.  Thus,  let  Di  =  Ij  and  E\  —  Ax  and  define 
D  —  Slit  and  E  =  7j.  Assuming  that  Q  is  a  multiple  of  Ii,  it  follows  that  Q  is  nonnegative  definite 
only  if  Si  <  v,  which  is  again  an  extremely  conservative  result.  The  reason  for  this  conservatism 
becomes  clear  by  noting  that  D  and  E  as  given  above  will  also  serve  as  bounds  for  perturbations 
of  the  form  axIi  for  which  the  range  of  nondestabilizing  <ti  is  \<Ti\  <  Si.  This  will  also  be  the  case 
for  all  factorizations  DiEi  of  Ai  since  DiDx  and  EXEX  must  be  positive  definite  and  thus  will 
also  serve  as  bounds  for  destabilizing  perturbations  such  as  oxli. 

Finally,  we  consider  a  nondestabilizing  uncertainty  affecting  the  interaction  of  a  pair  of  real 
poles.  Let  n  =  2,  A  —  ~I3,  V  =  R  =  Jj,  and  U  =  {4A  :  AA  =  axAx,  |ai|  <  5X},  where 
Ai  =  [°  q]  .  Obviously,  A  +  AA  remains  stable  for  all  values  of  <rx  since  AA  does  not  affect  the 
nominal  poles.  Note  that  Qaa  =  [**£1/4^*  *il$\  an^  7s (11)  =  where  this  worst-case  per¬ 

formance  is  achieved  for  ax  =  S\.  In  this  case  MLEl  has  the  solution  Q  =  (2—Sx)~1Ii  which  is  valid 
only  for  Sx  <  2,  an  extremely  conservative  robust  stability  result.  Furthermore,  the  corresponding 
performance  bound  tr  QR  =  2(2— fii)-1  is  conservative  with  respect  to  the  actual  worst-case  perfor¬ 
mance  ^5*  4-  In  constrast  MLE4  has  the  solution  Q  =  +Oo 

which  is  nonnegative  definite  for  all  Sx  so  long  as  a  <  2/Sx.  Hence  MLE4  is  nonconservative  with 
respect  to  robust  stability.  For  robust  performance,  tr  QR  =  2(2-a5x)_1  +  a_15x(2  — a5i)~*  which 
is  clearly  an  upper  bound  for  ^5*  +  1.  Choosing,  for  example,  a  =  Sxl  yields  tr  QR  =  Sx  +  2.  The 
parameter  a  can  also  be  chosen  to  minimize  tr  QR,  although  this  is  somewhat  tedious  to  carry  out 
analytically.  Finally,  MLE5  has  the  solution  Q  =  [^1+“  [l-fi-asoij/afj  exists  90 

long  as  a  <  1/SX.  Hence  MLE5  is  also  nonconservative  with  respect  to  robust  stability.  Choosing 
a  =  l/Sx  yields  tr  QR  =  +  |  which  lies  above  the  minimal  bound  ^5*  +  1.  Again,  a  can  be 

chosen  to  minimize  tr  QR. 
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11.  Numerical  Example 

In  this  section  we  consider  additional  examples  illustrating  the  results  developed  in  earlier 
sections.  In  contrast  to  the  analytical  examples  considered  in  Section  10,  however,  we  consider 
more  complex  examples  by  numerically  solving  the  modified  Lyapunov  equations.  Here  we  focus 
on  MLE4  and  MLE5  which  are  the  easiest  to  solve  numerically.  Specifically,  we  solved  MLE4  by 
using  the  representation  (7.2)  (although  this  may  not  be  practical  when  n  is  large),  and  we  solved 
MLE5  by  means  of  a  standard  Riccati  package.  To  simplify  matters  we  consider  only  uncertainties 
A  A  of  the  form  <T\A\.  Presentation  and  evaluation  of  robust  stability  and  performance  results  for 
multiparameter  uncertainty  can  be  fairly  complex  and  thus  is  deferred  to  a  future  numerical  study. 

Since  both  robustness  tests  MLE4  and  MLE5  depend  upon  an  arbitrary  positive  constant  a,  it 
is  desirable  to  determine  the  value  ot  at  which  yields  the  tightest  (i.e.,  lowest)  performance  bound  for 
each  robust  stability  range.  To  this  end  we  performed  a  simple  one-dimensional  search  to  determine 
the  best  such  a.  Although  analytical  techniques  may  assist  in  determining  optimal  values  of  a  mere 
efficiently,  the  search  technique  proved  to  be  adequate  for  the  examples  considered  here. 

As  a  first  example  we  consider  the  control  system  given  in  [1]  to  demonstrate  the  lack  of  a 
guaranteed  gain  margin  for  LQG  controllers.  Hence  consider 

*o(0  =  Ao*o(0  "b  +  u/j (t),  (11.1) 

y(t)  =  Co*o(0  +  wa(0>  (11.2) 


with  controller 


*e(0  =  Aexe{t)  +  Bey(t ), 
u(t)  =  Cexe(t), 


(11.3) 

(11.4) 


and  performance 


The  data  are 


J  =  lim  IE[xo  (t)f?iXo(<)  +  uT(t)i?2u(t)]. 
t  — +oo 


(11.5) 


Aq  = 


1  1 
0  1 


Vi  =  R%  =  p 


B0  = 

1  1 
1  1 


,  C0  =  [l  0J, 


,  Vj  =  f?2  =  1, 
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where  Vj  and  V3  are  the  intensities  of  u/i(t)  and  tv3  (t),  respectively.  Uncertainty  A  So  in  So  is  thus 
represented  by  ffiBi,  where  Si  =  [0  1]T.  Thus  the  closed-loop  system  corresponds  to 


Ao  BqCc 
BcCq  Ac 


Ai  = 


BiCe 

0 


A  = 


R  = 

where  the  zero  in  the  (2,2)  block  of  R  denotes  the  fact  that  we  are  considering  the  robust  perfor¬ 
mance  bound  for  the  state  regulation  cost  only.  Choosing  p  =  60,  it  follows  that  the  LQG  gains 
are  given  by 


Ri  01 

Vi  o 

0  0j 

>  V  —  ] 

0  BeV2Bj 

Ae  = 


-9  1 

-20  -9 


Bc  = 


10 

10 


Ce  =  [-10  -  10]. 


For  this  controller  the  actual  stability  region  corresponds  to  €  (—.07,  .01)  so  that  the  largest 
symmetric  region  about  <j\  =  0  is  |<ri)  <  .01.  The  worst-  case  performance  over  each  stability  region 
|<Ti|  <  is  denoted  by  the  solid  line  in  Figure  1,  while  the  performance  bounds  obtained  from 
MLE4  and  MLE5  are  shown  for  several  values  of  Si.  For  MLES  we  set  Di  =  [0  1  0  0]T  and 
Ei  =  [0  0  Ce\.  Note  that  MLE5  yields  considerably  tighter  estimates  of  worst-case  performance, 
particularly  as  Si  approaches  .01.  For  MLE4,  optimal  values  of  a  were  in  the  range  .0012  to  .0058, 
while  for  MLE5  (with  fl,10(-))  see  (5.26)),  a  was  in  the  range  .0143  to  .0020. 

As  a  second  example  we  consider  a  pair  of  nominally  uncoupled  oscillators  with  uncertain 
coupling.  This  example  was  considered  in  [45]  using  the  majorant  Lyapunov  technique.  Let 


A  = 


—v  Wi 
— UJl  —v 
0  0 
L  0  0 


0  0 
0  0 
—V  u3 
— Wj  —  V 


Ai  = 


0  0 
0  0 
1  0 
L0  1 


1 

0 

0 

0 


01 

1 

0 

0J 


v  =  .2,  u»i  =  .2,  wj  =  1.8,  R  =  V  =  J4, 
and,  for  MLE5,  define  D  =  Ai  and  E\  —  U.  We  consider  bounds  on  Js{U)  only. 


Figure  2  illustrates  the  exact  worst  case  performance  along  with  performance  bounds  obtained 
from  MLE4  and  MLE5.  For  MLE4  optimal  values  of  a  ranged  from  .036  to  .141  while  for  MLE5 
optimal  a  was  between  .361  and  .096.  Although  MLE4  was  slightly  less  conservative  than  MLE5, 
both  bounds  were  able  to  guarantee  robust  stability  only  for  Si  =  .15  while  the  largest  stability 
region  is  actually  Si  =  .54.  It  is  interesting  to  contrast  this  result  with  [45]  where  the  majorant 
Lyapunov  technique  yielded  a  robust  stability  range  of  Si  =  .4  for  a  richer  class  of  off-diagonal 
blocks  having  maximum  singular  value  less  than  Si. 
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Conclusion.  It  seems  clear  that  no  single  quadratic  Lyapunov  bound  is  superior  to  the  others. 
Although  the  conservatism  of  each  bound  is  problem  dependent,  it  is  desirable  to  better  understand 
the  nature  of  the  conservatism  in  order  to  utilize  the  bounds  in  an  effective  manner.  Finally,  the 
example  illustrated  in  Figure  2  may  indicate  fundamental  limitations  of  the  quadratic  Lyapunov 
function  approach  to  robustness  as  compared  to  the  majcrant  technique  of  (45].  These  remain 
questions  for  future  research. 
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The  Majorant  Lyapunov  Equation:  A  Nonnegative 
Matrix  Equation  for  Robust  Stability  and 
Performance  of  Large  Scale  Systems 
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Abstract— A  new  robust  stability  and  performance  analysis  technique 
is  developed.  The  approach  involves  replacing  the  state  covariance  by  its 
Mock'oorm  matrix,  i.e.,  the  nonnegative  matrix  whose  elements  are  the 
norms  of  subblocks  of  the  covariance  matrix  partitioned  according  to 
subsystem  dynamics.  A  bound  (i.e.,  majorant)  for  the  block-norm  matrix 
is  given  by  the  majorant  Lyapunov  equation,  a  Lyapunov-type  nonnega¬ 
tive  matrix  equation.  Existence,  uniqueness,  and  computational  tractabll- 
ity  of  solutions  to  the  majorant  Lyapunov  equation  art  shown  to  be 
completely  characterized  in  terms  of  M  matrices.  Two  examples  art 
considered.  For  a  damped  simple  harmonic  oscillator  with  uncertain  but 
constant  natural  frequency,  the  majorant  Lyapunov  equation  predicts 
unconditional  stability.  And,  for  a  pair  of  nominally  uncoupled  oscilla¬ 
tors  with  uncertain  coupling,  the  majorant  Lyapunov  equation  shows  that 
the  range  of  nondestabilizing  couplings  is  proportional  to  the  frequency 
separation  between  the  oscillators,  a  result  not  predictable  from  quadratic 
or  vector  Lyapunov  functions. 


I.  Introduction 

THE  importance  of  robustness  in  control-system  analysis  and 
design  cannot  be  overemphasized.  The  past  ten  years' 
literature  reflects  considerable  frequency-domain  development 
[11-[11],  while  recent  publications  indicate  increasing  time- 
domain  activity  1 12]— [19].  Wide  variations  in  underlying  assump¬ 
tions.  mathematical  settings,  and  problem  data  render  it  difficult, 
if  not  impossible,  to  clearly  delineate  Jie  relative  effectiveness  of 
different  methods.  Our  own  philosophical  outlook  has  thus  been 
guided  by  two  general  criteria: 

1)  effectiveness  for  simple  examples: 

2)  efficiency  when  applied  to  large  scale  problems. 

The  first  criterion  involves  applying  robustness  techniques  to 
simple,  perhaps  trivially  obvious,  examples  to  serve  as  "acid 
tests.”  A  given  method’s  effectiveness  on  a  collection  of  such 
examples  can  possibly  reveal  inherent  shortcomings.  As  an 
illustration  of  this  criterion,  consider  a  damped  harmonic  oscilla¬ 
tor  with  constant  but  uncertain  natural  frequency.  Using  the 
notation  of  [6],  stability  is  guaranteed  so  long  as 

<7m»,  l  R  (ju)U  +  c  0'u>)  K iju))  - 1 G  (ju)L  ■■  ‘(yu)]  <  1 ,  uzO 

(11) 

where,  for  v  >  0, 

G(j)  =  (j2+2i'S  +  «J)‘i 
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and  uncertainty  in  the  nominal  natural  frequency  is  modeled  by 
A(s)  =  £-'(s)0(5)R(s)  =  5<^, 

L(s)=  1/a,  0(s)  =  6/a,  R(s)  =  a>j;,  A'(j)  =  0, 

6  £  (-min  (1,  a),  a],  a>0. 

Note  that 

<w[0  (/<*•')]£  1,  uzO 

as  required  in  [6],  The  perturbation  A (s)  (modeled  as  a  feedback 
gain)  effectively  replaces  u-  in  G(s)  by  (1  +  6)u*.  Hence,  for  a 
given  a  >  0  this  uncertainty  model  permits  perturbed  natural 
frequencies  in  the  range  [0.  (1  +  a) 1  :a>„].  Evaluating  (1.1)  yields 
the  upper  bound 

«<[(“i_“2):  +  4»':a':]1  :/u>;,  iiikO  (1.2) 

or.  equivalently, 

a<2f(l-rJ)'2  (1.3) 

where  f  s  The  conservatism  of  (1.3)  is  obviously  most 
pronounced  when  the  damping  ratio  f  is  small.  In  all  cases, 
however,  the  conservatism  is  infinite. 

The  second  criterion  is  obviously  subjective  and  depends  upon  a 
variety  of  factors  such  as  problem  structure,  designer  experience, 
and  computational  resources.  This  criterion  is,  in  our  opinion, 
most  important  since  the  need  for  robustness  techniques  becomes 
increasingly  critical  as  system  complexity  grows.  Indeed,  the 
ultimate  test  of  a  given  approach  is  to  scale  it  up  to  larger  and 
larger  problems  to  reveal  inherent  limitations.  Obviously,  such 
tests  are  not  only  difficult,  but  may  entail  a  significant  commit¬ 
ment  of  human  and  financial  resources.  Nevertheless,  crude 
predictions  are  sometimes  available,  and  a  case  in  point  is  the 
"curse  of  dimensionality"  encountered  in  the  approach  of  [9]. 
Another  example  involves  computational  difficulties  in  obtaining 
bounds  for  the  jt-function  with  more  than  three  blocks  [10]. 

The  contribution  of  the  present  paper  is  a  new  robustness 
analysis  method  developed  specifically  for  large  scale  systems. 
The  basic  idea,  motivated  by  the  work  of  Siljak  [30]  on  connective 
stability,  is  as  follows.  The  system  is  assumed  to  be  in  the  form  of 
a  collection  of  subsystems  with  uncertain  local  dynamics  and 
uncertain  interactions. 1  Parameter  uncertainties  are  modeled  as 
either  structured  or  unstructured  constant  variations  contained  in 
prescribed  sets.  The  state  covariance,  partitioned  conformably 
with  the  subsystem  dynamics,  is  replaced  by  its  block-norm 
matrix,  i.e. ,  the  nonnegative  matrix  each  of  whose  elements  is  the 
norm  of  the  corresponding  subblock  of  the  original  matrix.  This 
nonnegative  matrix  satisfies  a  novel  inequality  designated  the 

1  Uncertainties  in  a  single  subsystem  can  also  be  regarded  as  interaction 
uncertainties.  To  see  this,  write  x  *  (A  +  G)ir  twice  so  that  the  uncertainty 
C  is  represented  by  (°  £J. 
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covariance  block-norm  inequality.  The  existence  of  a  solution 
to  the  majorant  Lyapunov  equation,  i.e.,  the  covariance  block- 
norm  inequality  interpreted  as  an  equation,  yields  an  element-by- 
element  bound  (i.e.,  majorant)  for  the  covariance  block-norm, 
hence,  assuring  robust  stability  and  performance.  The  relevance 
of  this  technique  to  large  scale  systems  stems  from  the  fact  that 
replacing  each  subblock  of  the  covariance  by  its  norm  can 
significantly  reduce  the  dimension  of  the  problem.  Indeed,  the 
dimension  of  the  majorant  Lyapunov  equation  is  equal  to  the 
number  of  subsystems  which  may  be  significantly  less  than  the 
dimension  of  the  original  system. 

To  illustrate  die  above  ideas  in  more  detail,  consider  the 
covariance  equation 

0 =(A  +  G)Q+Q(A  +  G)t+V  (1.4) 

where  A  denotes  the  nominal  dynamics,  G  denotes  uncertainty  in 
A,  V  is  the  disturbance  intensity,  and  Q  is  the  state  covariance. 
Assuming  that  A  is  block  diagonal  with  r  diagonal  blocks  leads  to 
the  covariance  block-norm  inequality  (see  Proposition  4.2) 

a*-Q,sJSS$+$Sr+‘V.  (1.5) 

In  (1.5),  OL,  Q,  g.  and  V  are  r  x  r  nonnegative  matrices,  i.e., 
each  element  is  a  nonnegative  number.  The  matrices  Q,  and  V  are 
formed  by  taking  the  Frobenius  norm  of  each  subblock  of  Q  and 
V,  while  each  component  of  g  is  a  given  constant  which  bounds 
the  spectral  norm  (largest  singular  value),  of  the  corresponding 
subblock  of  the  uncertain  perturbation  G.  Hence,  §  is  a  majorant 
for  G  in  the  sense  of  [21]-[23].  Each  element  of  the  matrix  <2  is 
bounded  above  by  the  smallest  singular  value  of  the  Kronecker 
sum  [24]-[26]  of  pairs  of  diagonal  blocks  of  A.  The  operation 
is  die  Hadamard  product  [27],  [28],  and  the  ordering 
"SS"  denotes  element-by-element  comparison,  i.e.,  the  order¬ 
ing  induced  by  the  cone  of  nonnegative  matrices  [29],  [30]. 

The  majorant  Lyapunov  equation  is  obtained  by  replacing  the 
inequality  (1.5)  by  the  r  x  r  nonnegative  matrix  equation 

a  *  $=S$+$Sr+v.  (1.6) 

A  key  result  (Corollary  5.1)  states  that 

(17) 

for  all  stable  A  +  G.  Consequendy  (see  Theorem  5.1),  the 
existence  of  a  unique  solution  to  (1.6)  leads  direcdy  to  a  guarantee 
of  robust  stability  over  the  range  specified  by  £  and  to  a 
performance  bound  involving  $.  Moreover,  solutions  of  (1.6) 
exist  if  and  only  if  the  r 2  x  r1  matrix 

A  ^  diag  (vec  a)-Q  e  £  (1.8) 

is  an  M  matrix  [29],  [30]. 

Even  when  the  number  of  subsystems  is  large,  the  majorant 
Lyapunov  equation  is  generally  computationally  tractable.  Specif¬ 
ically,  although  A  is  an  r1  x  r‘  matrix,  no  computations 
whatsoever  need  to  be  carried  out  with  matrices  of  this 
dimension.  Rather,  it  suffices  to  solve  only  the  majorant 
Lyapunov  equation  (1.6).  In  this  regard  we  show  that  $  is  given 
by 

$  =  «im$,  (1.9) 

/— 0» 

where  if  G  has  only  off-diagonal  nonzero  blocks  the  sequence 
{$.}  is  generated  by 

a*$,*,»g$,+$,S7'+'v.  $0=0  (1.10) 

and  is  monotonically  increasing.  Furthermore,  the  convergence  of 
this  sequence  is  equivalent  to  A  being  an  M  matrix  so  that  it  is  not 
even  necessary  to  form  A-  Note  that  (1.6)  does  not  require  the 
development  of  new  solution  techniques.  Indeed,  since  (1 . 10)  is  a 


straightforward  iteration,  (1.6)  is  even  easier  to  solve  than  the 
original  Lyapunov  equation  (1.4). 

To  illustrate  these  results  we  consider  two  examples.  The  first 
example  is  the  damped  oscillator  already  considered  in  this 
section.  With  little  effort  the  majorant  Lyapunov  equation  yields 
the  (obvious)  result  that  the  oscillator  is  stable  for  all  constant 
natural  frequencies.  The  second  example  involves  a  pair  of 
oscillators  with  known  parameters  but  with  uncertain  coupling. 
The  majorant  Lyapunov  equation  yields  bounds  over  which 
stability  is  guaranteed,  and  these  bounds  are  compared  to  the 
actual  stability  region  as  a  function  of  frequency  separation.  The 
main  result  shows  that  the  robustness  to  uncertain  coupling  is 
proportional  to  the  frequency  separation.  This  weak  subsystem 
interaction  robustification  mechanism  is  the  principal  contribution 
of  the  majorant  theory.  This  example  has  immediate  application  to 
the  problem  of  vibration  control  in  flexible  structures.  For  this 
class  of  problems  the  open-loop  dynamics  can  be  viewed  as  a 
collection  of  uncoupled  oscillators  which  become  coupled  via 
feedback  and  structural  uncertainties. 

The  majorant  bound  developed  in  the  present  paper  is  quite 
different  from  the  widely  used  quadratic  Lyapunov  function  (see, 
e.g.,  [12]— [20]).  As  can  readily  be  shown  using  the  methods  of 
[12],  [171— [20],  the  quadratic  Lyapunov  function  yields  robust 
stability  and  performance  by  replacing  (1.4)  by 

0  =  AQ+QAt+Q{Q)+V  (1.11) 

where  £)(  •)  satisfies 

GQ+QGT  s(l(£)  (1.12) 

for  all  variations  G.  It  can  then  be  shown  that 

Q*G  (1.13) 

where  now,  in  contrast  to  (1.7),  the  ordering  in  (1.13)  is  deftned 
with  respect  to  the  cone  of  nonnegative-definite  matrices. 
Indeed,  the  majorant  bound  may  be  more  closely  related  to  vector 
Lyapunov  functions  [30],  [31]  and  the  Lyapunov  matrix  function 
[32],  [33].  It  does  not  appear  possible,  however,  to  use  these 
techniques  to  obtain  the  majorant  results  on  robustness  due  to 
subsystem  frequency  separation. 

The  reader  will  observe  that  this  paper  exploits  a  wide  variety 
of  techniques  including  nonnegative  matrices,  block  norms, 
matrix  majorants,  the  Hadamard  product,  the  Kronecker  sum,  and 
AS  matrices.  Each  of  these  techniques,  except  majorants,  has, 
however,  been  previously  applied  to  control  problems  in  numer¬ 
ous  instances.  In  the  special  case  of  scalar  subblocks,  the  block- 
norm  matrix  has,  moreover,  been  utilized  by  Yedavalli  [13]— [15] 
and  others  for  robustness  analysis  and  design.  In  this  case  the 
block  norm  is  known  as  the  matrix  modulus.  The  variety  of 
algebraic  structures  employed  in  the  present  paper  should  not  be 
surprising  since  the  quest  for  increasingly  refined  robustness 
techniques  can  be  expected  to  invoke  correspondingly  refined 
uncertainty  bounds.  Related  techniques  are  employed  in  [11]. 
Furthermore,  nonnegative  matrix  equations  involving  M  matrices 
arise  naturally  in  a  variety  of  settings  (see,  e.g.,  [38],  [39]). 

The  contents  of  the  paper  are  as  follows.  Section  II  presents 
notation,  definitions,  and  lemmas  for  use  throughout  the  paper.  In 
Section  III  robust  stability  and  performance  are  defined  for  the 
homogeneous  and  nonhomogeneous  systems.  Detailed  system 
structure  and  uncertainty  characterization  are  given  in  Section  IV 
and  the  covariance  block-norm  inequality  is  derived.  Section  V 
analyzes  the  majorant  Lyapunov  equation  to  obtain  a  majorant  for 
the  steady-state  covariance.  The  main  result.  Theorem  5.1, 
guarantees  robust  stability  and  provides  a  performance  bound. 
Finally,  the  examples  appear  in  Section  VI. 

n.  Preliminaries 

The  following  notation  will  be  used  throughout.  All  matrices 
are  assumed  to  have  real  entries. 
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s 

W,  E'**,  W 

Ip,  0 pxq,  0 p 


* 

coUZ) 
vec  (Z) 


Zuj) 

ZT 
ZT 
tt  Z 

diag  (Z i. 


Zp) 


block-diag  (Z,,  •  •  •,  Zp) 
/*Z) 

asymptotically  stable 
matrix 

nonnegative-definite 

matrix 

positive-definite 
matrix 
Z|  2  Z1 
z,  >  Z2 

nonnegative  matrix 

positive  matrix 
Z,  2  2  Z2 
Z,  ►  Zj 
Z"1 

block-norm  matrix 


majorant 

II Z  || ; 
ff,(Z) 

ttmin(Z)* 

®B1«  (Z) 

X™(Z) 

IIZII, 


expected  value 

real  numbers,  pxq  real  matrices, 
E'xl 

pxp  identity  matrix,  pxq  zero  ma¬ 
trix,  Opxp 

Kronecker  sum,  Kronecker  product 
124]— [27] 

Hadamard  product  [27],  [28] 
ith  column  of  matrix  Z 

[col,  (Z)  1 

er.zG  e **« 

col,  (Z)  J 

(/,  /')  element  of  matrix  Z 
transpose  of  vector  or  matrix  Z 
(Z7")'1  or  (Z~X)T 
trace  of  matrix  Z 

diagonal  matrix  with  listed  diagonal 
elements 

block-diagonal  matrix  with  listed  diag¬ 
onal  blocks 
spectral  radius  of  Z 
matrix  with  eigenvalues  in  open  left- 
half  plane 

symmetric  matrix  with  nonnegative  ei¬ 
genvalues  (Z  2  0) 

symmetric  matrix  with  positive  eigen¬ 
values  (Z  >  0) 

Z,  -  Z2  2  0,  Z|,  Z2  symmetric 

Z,  —  Zj  >  0,  Z„  Z2  symmetric 

matrix  with  nonnegative  elements 

(Z  2  2  0)  [29].  [30] 

matrix  with  positive  elements  (Z  ►  0) 

Z,  —  Zj  2  2  0 

Z,  -  Zj  ►  0 

Hadamard  inverse,  (ZH,){iJ)  & 
fZ(/,y,J  ',  Z  ►  0 

nonnegative  matrix  each  of  whose  ele¬ 
ments  is  the  norm  of  a  corresponding 
subblock  of  a  given  partitioned  matrix 
nonnegative  matrix  each  of  whose  ele¬ 
ments  bounds  the  corresponding  ele¬ 
ment  of  a  block-norm  matrix 
Euclidean  norm  of  vector  Z 
singular  value  of  matrix  Z 
smallest  and  largest  singular  values  of 
matrix  Z 

largest  eigenvalue  of  symmetric  matrix 
Z 

<7m«(Z)  (spectral  norm  induced  by 

Hr) 


|Z||, 


(tr  ZZr)1 


■- [  1  *-■■] 
■Ltd" 


(Frobenius  norm  [34]). 

In  subsequent  sections  we  shall  exploit  the  fact  that  the  norms 
■  "  "  and  ||  •  || F  coincide  for  vectors.  Hence,  if  Z  €  Kp, 


then  by  interpreting  Ep  =  Epxl  it  follows  that 


(2.1) 


Furthermore,  if  Z  €  then 

||Z||,sJZ||f-||vec  Z\\F=  ||  vec  Z||2*||vec  Z||,.  (2.2) 


Lemma  2.1:  If  Z  €  W*"  and  Z  6  It**'  then 

Omin (Z) II Z II f £  II ZZ II F ^  II Z II , II Z II f.  (2.3,  2.4) 

If,  furthermore,  p  =  <?  =  r  Z  2  0,  and  Z  is  symmetric,  then 
tr  ZZs(tr  Z)WZ)s(tr  Z)||Z||„  (2.5) 

Proof:  Inequality  (2.4)  can  be  found  in  [35,  p.  263].  To 
prove  (2.3),  note  that  when  Z  is  singular  the  result  is  immediate. 
Otherwise,  if  p  =  q  replace  Z  and  Z  in  (2.4)  by  Z*1  and  ZZ, 
respectively.  The  result  now  follows  from  [omu(Z)]'1  = 
ffmrn (Z*1).  If p  *  q,  then  related  arguments  apply.  Finally,  (2.5) 
is  given  in  [36].  □ 

Recall  [30]  that  a  matrix  S  €  Jlrxr  is  an  N  matrix  if  S((J)  s  0, 
/,  j  =  1 ,  •  ■  • ,  r,  i  *  j.  If,  in  addition,  all  principal  minors  of  S  are 
positive,  then  S  is  an  M  matrix. 

Lemma  2.2:  Suppose  S  €  Jl'*'  is  an  N  matrix.  Then  the 
following  are  equivalent: 

i)  S  is  an  M  matrix; 

ii)  det  S  *  0  and  S'1  2  2  0; 

iii)  for  each  y  €  E',  y  2  2  0,  there  exists  a  unique  x  &  Jlr,x 
22O.  such  that  Sx  =  y  \ 

iv)  there  exists  x  €  Er,  *  2  2  0.  such  that  Sx  ►  0; 

v)  /,  *  S  ►  0  and  each  diagonal  matrix  D  >  lr  *  S  satisfies 
p[D-'(I,*S  -  S)]  <  1. 

Proof:  The  equivalence  of  statements  i),  ii),  iv),  and  v) 
follows  from  [30,  p.  396].  The  implication  ii)  ■*  iii)  is  immediate, 
and  iii)  •  iv)  follows  by  settings  =  [1  1  •  •  •  l]r.  □ 

Lemma  2.3:  Suppose  S  €  W*r  is  an  M  matrix  and  let  S  € 
Jlrxr  be  an  N  matrix  such  that  5  2  2  S.  Then  5  is  an  M  matrix. 

Proof:  See  [30,  p.  400].  □ 


m.  Robust  Stability  and  Performance  Bounds 

Consider  the  Mh-order  homogeneous  system2 

x(t)  =  (A(d)  +  G)x(t),  re[0,  oo),  (3.1) 

G  G  8  C  Jl"*”,  (3.2) 

e  e  e  c  jr,  (3.3) 

where  A  :9  -*  Enxn  is  continuous,  A  s  A(S)  denotes  the  known 
nominal  dynamics  for  6  €  0,  6  denotes  the  unstructured 
parametric  uncertainty  in  A,  G  denotes  the  structured  parametric 
uncertainty  in  A ,  and  0  €  §  is  the  nominal  value  of  G.  We  first 
consider  the  stability  of  (3.1)  over  S3  and  0. 

Definition  3.1:  If  A  (0)  +  G  is  asymptotically  stable  for  all  G 
€  a  and  6  E  0,  then  the  homogeneous  system  (3.1)  is  robustly 
stable  over  S  and  0. 

Now  consider  the  nth-order  nonhomogeneous  system 

x(t)  =  (A(6)+G)x(t)  +  w{t),  (£[  0.  oo)  (3.4) 

where  G  €  $,  6  €  0,  and  w(  • )  is  white  noise  with  intensity  V  2 
0.  For  given  G  6  U  and  6  €  0,  the  steady-state  average 
quadratic  performance  is  defined  by 

J(G,  6)  £  lim  sup  I[xr(I)Rx(/)]  (3.5) 

f“*0» 

where  R  -  RT  2  0.  The  system  (3.4)  may,  for  example,  denote 
a  control  system  in  closed-loop  configuration.  There  is  no  need  in 
our  development,  however,  to  make  such  distinctions. 

In  practice,  steady-state  performance  is  only  of  interest  when 
the  system  is  robustly  stable.  The  following  result  is  immediate. 
Proposition  3.1:  Suppose  the  system  (3.1)  is  robustly  stable 


2  Upon  Tim  reading  the  uncertainty  represented  by  (3.3)  can  be  ignored 
since  the  principal  contribution  concerns  the  treatment  of  (3.2). 
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over  ®  and  6.  Then  for  each  G  €  $  and  0  €  0, 

J(G,d)-ttQR  (3.6) 

where  n  x  n  nonnegative-definite  Q  is  the  unique  solution  to 

0  ~(Am  +  0)Q  +  Q{A{e)+G)T+V.  (3.7) 

We  shall  only  be  concerned  with  the  case  in  which  $  and  6  are 
compact.  Since  Q  is  a  continuous  function  of  G  and  0,  we  can 
define  the  worst-case  average  steady-state  quadratic  performance 

/nu  4  max  J{G,  0).  (3.8) 

ce»,*ee 

Since  it  is  difficult  to  determine  explicitly,  we  shall  seek 
upper  bounds. 

Definition  3.2:  If  s  a,  then  a  is  a  performance  bound 
for  the  nonhomogeneous  system  (3.4)  over  £  and  6. 

IV.  System  Structure,  Uncertainty  Characterization,  and 
the  Covariance  Block-Norm  Inequality 

A  discussed  in  Section  I,  (3.1)  and  (3.4)  are  assumed  to  be  in 
the  form  of  a  large  scale  system  with  uncoupled  local  dynamics 
and  uncertain  interactions.  Hence,  with  the  subsystem  partitioning 

r 

n^Yini  (4.1) 

'-i  .. 

the  local  system  dynamics  >4(0)  can  be  decomposed  into 
subsystem  dynamics  according  to 

A  (8)  =  block-diag  { ,4,(0)}  (4.2) 

where  >4/(0)  €  jr>x%  0  6  0.  For  convenience,  denote 
A  4  block-diag  {>4,}. 

,r 

Accordingly.  R  is  assumed  to  be  of  the  form 


R=  block-diag  {/?,} 

#•!,*  ,r 

(4.3) 

where  R,  €  Jin’xn‘,  R,  Z  0,  /  =  1,  •  •  •,  r.  The  intensity  V  and 
steady-state  covariance  Q  satisfying  (3.7)  are  assumed  to  be 
conformably  partitioned,  i.e.. 

(4.4) 

Q/j  e 

(4.5) 

For  notational  simplicity  define 

K  4  Qi  4  i=1,  ’ 

",r.  (4.6) 

Taking  the  Frobenius  norm  of  each  subblock  of  V  and  Q  leads  to 
the  r  x  r  symmetric  nonnegative  matrices  V  and  Q.  defined  by 


v  4  {IIM,}',;.,,  <3.  4  {WQuWfY^.v  (4.7) 

Note  that 

Ildllf-IIOIIf.  imif=|M|.r.  (4.8) 

A  few  observations  concerning  the  nominal  system,  i.e.,  with 
G  =  0  and  0  =  6,  are  worth  noting.  If  >4  is  stable  then  so  is  >4/,  i 
=  1,  -  ",  r,  and  there  exist  unique,  nonnegative-definite  Qit  P, 
€  i  =  I,  •••,  r,  satisfying 

0  =  >4,£,  +  £//4,r+  V„  (4.9) 

0~AfP  +  P,A,  +  Ri.  (4.10) 


Proposition  4.1:  Suppose  >4  is  asymptotically  stable.  Then  the 
nominal  performance  is  given  by 

*fnom  4  AO.  6)=  £  tr  £*,-  2  tr  P  Vt.  (4.11) 

I- 1  /-i 

Proof:  First  note  that  with  G  =  0  and  0  =  6  the  diagonal 
blocks  of  Q  satisfying  (3.7)  coincide  with  Q\,  •••,&.  Thus 

J(0,  8)  =  %  tr  0<Rt 

(■I 

r 

mY  (vec  6-)r  vec  /?, 

/•I 

r 

=  Yd  •  At) ~ 1  vec  Vi]  t  vec  /?/ 

/-I 

r  • 

(vec  vec  R, 

im  I 

r 

=  2  (vec  V,)T  vec  Pt 

I- 1 

=  £  tr  P  Vf.  G 

/ml 

The  matrices  G  E  S  are  also  conformably  partitioned  so  that 
G={Gv}'Jml,  Gu  6  »-.■«">  (4.12) 

and  >9  is  characterized  by 

«  4  {G  €  «”«  :  o^Gy) Syu,  i,j=  1,  r]  (4.13) 

where  y /j  tt  0,  i,  j  =  !,•••,  r,  are  given  constants.  For 
convenience,  define  the  r  x  r  nonnegative  matrix 

S  *  fr,,}',.,.  (4.14) 

The  bound  9  is  a  matrix  majorant  for  C  €  11  in  the  sense  of 
[21M23J. 

Remark  4. 1:  ®  is  compact  and  convex. 

Finally,  let  symmetric,  positive  G  6  W*r  satisfy 

a(,.y,S  min  {ffmj„(>4/(0)  *4,(0))},  i,j=  1,  ■■  ■,  r.  (4.15) 


Proposition  4.2:  Let  G  €  S  and  0  €  0  be  such  that  >4  (0)  + 
G  is  asymptotically  stable  and  let  n  x  n  Q  St  0  satisfy  (3.7). 
Then  Q.  defined  by  (4.7)  satisfies 


d  *  Q,s  sSQ,+Q,97'+V 

(4.16) 

or,  equivalently. 

A  vec  s  vec  *V, 

(4.17) 

where 

A  4  [diag  (vec  G)]  -  8®  8. 

(4.18) 

Proof:  Expanding  (3.7)  yields 

r 

-{AmQij  +  Q/)A](*)\=Y  l CikQkl  +  QlkGTJk]+  Vy, 

I 

iJm  U  ’‘sr.  (4.19) 
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Bounding  the  right-hand  side  of  (4.19)  from  above  using  (2  4) 
yields  for  all  G  €  <g 

2  lGutQ*j  +  Qi*GTt]+  K^||^ 

r 

s  2  I8(/.*)Q.(*j)  +  4<i.*>8u.*)] + 

*-i 


while  bounding  the  left-hand  side  of  (4. 19)  from  below  using  (2.3) 
implies  for  all  9  €  0 

I!  - Mi(«)Q</+  QyAjmi ||f  =  ||vec  (Ai(0)Qo  +  QUA  T (0))|| F 
=  ||(Ai(0)  ®  Aj(6))  vec  Qu\\f 
a <r«i»M;(0)  •  /*,(«))  II vec  Qij\\r 

Combining  the  above  inequalities  yields  (4.16).  □ 

Remark  4.2:  Since  g  as  0,  therJ  x  r1  matrix  A  is  an  N 
matrix  [30]. 

V.  The  Majorant  Lyapunov  Equation 

In  this  section  we  interpret  (4. 16)  as  an  equality  rather  than  an 
inequality  and  consider  the  Lyapunov-type  nonnegative  matrix 
equation 

ft  *  4=S4+4Sr+,v  (5.1) 

or,  equivalently, 

A  vec  4= vec  V.  (5.2) 

Note  that  since  ft  and  V  are  symmetric  a  unique  solution  of  (5.1) 
is  necessarily  symmetric. 

Proposition  5.1:  The  following  arc  equivalent: 

i)  A  is  an  M  matrix; 

ii)  det  A  *  0  and  A~ 1  2^0; 

iii)  for  each  r  x  r  symmetric  V  ii  0  there  exists  a  unique  r 
x  r  2  2:  0  satisfying  (5.1); 

iv)  there  exist  r  x  r  symmetric  V  >  0  and  r  x  r  symmetric 
2:  a  0  satisfying  (5.1); 

v)  diag  (vec  ft)  -  (7,  *  S)  ®  (A  *  S)  ►  0  and  each  diagonal 
matrix  3)ii  diag  (vec  ft)  -  (/,  *  8)  a  (7r  *  8)  satisfies 

P(»-'IS®S-(A*  8)®(A*8)1)<1;  (5.3) 

vi)  for  each  r  x  r  symmetric  4o  ^  ^  0  and  r  x  r  symmetric  V 

0,  the  sequence  generated  by 

a  •  4,>  i  -  (A  •  8)4, ♦ .  -  4,> .(/,  •  8) 

-(S-A*S)4(  +  4/(S-A*S)r+V.  i-0,  1,  (5.4) 

converges; 

vii)  for  each  r  x  r  symmetric  §.0  2  2  0  there  exists  r  x  r 
symmetric  V  ►  0  such  that  the  sequence  {4/}“ ,  generated  by 
(5.4)  converges. 

Proof:  Statements  i)-v)  are  equivalent  to  i)-v)  of  Lemma 
2.2.  Clearly,  vi)  implies  iii),  and  vii)  implies  iv).  To  show  v) 
implies  vi)  and  vii)  note  that  7,2  *  (8  •  8)  ”  (A  *  8)  •  (A  *  8) 
and 

vec  (ft  «  4/*i)- [diag  (vec  ft)]  vec  4/+ i- 


Thus,  (5.4)  is  equivalent  to 

vec  4«>  i  =  [diag  (vec  ft)  -  (A  *  8)  ®  (A  *  8)1 " 1 

■  18  ®  S-Ai  *  (8  •  8)1  vec  4;  +  [diag  (vec  ft)]"'  vec  V. 

Thus,  vi)  and  vii)  follow  from  v)  with  3D  =  diag  (vec  ft)  -  (A  * 
8)  ®  Ur  *  8).  □ 

Since  statements  i)— vii)  depend  only  upon  ft  and  8  we  have  the 
following  definition  inspired  by  v)-vii). 

Definition  5.1:  (ft,  8)  is  stable  if  A  is  an  M  matrix. 
Remark  5.1:  When  /,  *  8  =  0,  i.e.,  when  the  local  dynamics 
have  no  structured  uncertainty,  (5.4)  simplifies  to 

e  *  4,+  i  =  e4,  +  4/Sr+V,  i=0,  1,  (5.5) 

or,  equivalently, 

4,> i  =  ft w  *  (S4,  +  4,8 r+ V),  i=0,  1,  •  •  •.  (5.5a) 

The  following  result  shows  that  for  zero  initial  condition,  the 
iterative  sequence  is  monotonic. 

Proposition  5.2:  Suppose  diag  (vec  ft)  -  Aa  *  (8  ®  8)  ►  0. 
Then  the  sequence  { 4,}  “  ,  generated  by  (5.4)  with  4«  =  0  and  V 
2  2  0  is  monotonically  increasing. 

Proof:  To  simplify  notation  we  consider  the  case  mentioned 
in  Remark  5.1.  Hence,  assume  ft  ►  0.  Clearly,  if  S0  =  0,  then 
(5.5a)  implies  that  St  =  Gw  •  V  2  2  0.  Hence,  q,  2  2  <$,0- 
Defining  a4,>  i  ft  4,-i  -  4,-  (5.5a)  yields 

a4,.  i = ew  *  (Sa4,+ a4,S  r). 

Since  2  2  0,  the  result  follows  from  induction.  □ 

Remark  5.2:  Proposition  5.2  is  a  particularly  useful  result  in 
applications  and  can  be  utilized  as  follows.  Setting  §.o  =  0,  the 
sequence  { 4<}  can  be  evaluated  by  a  simple  numerical  procedure. 
As  will  be  shown  in  Theorem  5. 1  below,  each  corresponds  to  a 
robust  performance  measure  a,.  For  practical  purposes  the 
increasing  sequence  {a,}  can  be  generated  until  either  conver¬ 
gence  is  attained  (in  which  case  a  =  Urn,-.,  a,  is  a  robust 
performance  bound)  or  a  maximum  permissible  performance  level 
is  exceeded.  In  the  latter  case  the  question  of  convergence  is 
irrelevant  since  the  closed-loop  system  is  known  to  either  be 
unstable  for  some  G  €  IS  (i.e.,  a  =  oo)  or  exceed  acceptable 
performance  specifications,  thereby  necessitating  system  rede¬ 
sign. 

We  now  prove  a  comparison  result  for  solutions  of  (5.1). 
Lemma  5.1:  Assume  (ft,  8)  is  stable,  let  d,  §  be  r  x  r 
nonnegative  matrices  where  &  is  symmetric,  and  assume  that 

ftssft,  §ss8-  (5.6) 

Then  (d,  §)  is  stable.  Furthermore,  let  r  x  r  symmetric  satisfy 

^SSV,  (5.7) 

let  4  be  the  unique,  nonnegative  solution  to  (5.1),  and  let  4  be  the 
unique  solution  to 

d  *  4*84+48r+^-  (5.8) 

Then  if  §,  2  2  0,  it  follows  that 

4**4-  (5.9) 

Proof:  Since 

A  ft  diag  (vec  d)  -  g  •  § 
is  an  N  matrix,  A  is  an  M  matrix,  and 

A  -  A  =diag  (vec  (d  -  ft))  +  (8-  8)  •  (8  -  6)*  *0 
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it  follows  from  Lemma  2.3  that  A  is  an  M matrix,  and  thus  (&,  §) 
is  stable.  Next  note  that  (3.1)  and  (3.8)  imply 

vec  (4~ 4)”  A*'(A-3)  vec  4+  A-1  vec  (V-’C’). 

Since  &  -  &  2  2  0,  (see  Lemma  2.2),  V  -  ^  a  as 

0,  and  4  2:  X  0,  it  follows  that  (3.9)  is  satisfied.  □ 

Corollary  5.1 :  Suppose  (Cl,  Q)  is  stable  and  let  Si  be  the 
unique,  nonnegative  solution  to  (3.1).  Furthermore,  let  G  E  £ 
and  6  G  ©  be  such  that  A(6)  +  G  is  asymptotically  stable  and 
define  4  by  (4.7)  for  n  x  n  Q  Ss  0  satisfying  (3.7).  Then 

4s  s  4-  (5.10) 

Proof:  By  Proposition  4.2,  Q,  satisfies  the  covariance  block- 
norm  inequality  (4.16).  In  the  notation  of  Lemma  3.1  define 

d  =  Ct,  5  =  6,  *0  =  6  *  4-(SQ.  +  Q.Sr)  (5.11) 

so  that  (3.6)  is  satisfied  and  (4.16)  implies  (S.7).  Note  that  with 
the  notation  (3. 11),  equation  (3.8)  has  die  unique  solution  4=4 
a  a  0.  Hence  (5.9)  implies  (5.10).  □ 

Theorem  5.1:  Assume  A  is  asymptotically  stable,  0  is 
continuously  arewise  connected,  and  ((2,  8)  *s  stable.  Then  the 
homogeneous  system  (3.1)  is  robustly  stable  over  3  and  0,  and 
the  nonhomogeneous  system  (3.4)  has  the  performance  bound 

d=  max  £  Jj  [tr  (G,(8)R,)  +  2  (tr  A(0))(Q4)<,..>]J  (5.12) 

where  n ,  x  n,  nonnegative-defmite  @,(8)  and  P,(8)  satisfy 

0*AI(fl)<?I(e)  +  <5.(«M,r(fl)+  Vi.  (5.13) 

Q-A  f(8)P,(8)  +  P,(8)A,(8)  +  R,  (5. 14) 

and  r  x  r  4  is  the  unique,  nonnegative  solution  to  (5.1). 

Proof:  First  note  that  since  robust  stability  is  independent  of 
the  disturbances,  we  can  set  V  *  /„  for  convenience  in  proving 
the  first  result.  Hence,  suppose  (3.1)  is  not  robustly  stable.  Since 
3  is  convex  (see  Remark  4.1  ).A  is  asymptotically  stable,  and  0  is 
continuously  arewise  connected,  there  exist  G0  €  3  and  9:[0,  1) 
-*  0  such  that  A(n)  a  A(S(t *))  +  fiG0  is  asymptotically  stable 
for  all  m  €  [0,  1),  and  A{\)  is  not  asymptotically  stable.  Define 

GO*.  O  4  r  eA{M),eATw‘  ds,  tz 0,  M  €  [0,  1] 

Jo 

which  is  monotonically  increasing  in  the  nonnegative-defmite 
cone  with  respect  to  t.  Clearly,  the  limit 

Q0*)  a  lim  QO*.  O.  m  6  (0,  1) 

t—m 


exists  and  satisfies 

o=A(m)QW  +  Q(m)At(m)+I'..  m  €  [0, 1). 

Now  define  r  x  r  nonnegative  symmetric  4(m)  by 

400  =  {IlCtfOOII f)\j. , 

where  Qv(n)  €  and  Q(m)  is  partitioned  as  in  (4.5).  By 

Corollary  5. 1  with  9  *  9(p),  G  =  fiG0,  4  4  4 (>*).  M  0  [0,  1), 
and  V  *  /„,  it  follows  from  (5. TO)  that 

40*)ss4.m  €  10,  1).  (5.15) 


On  the  other  hand,  for  n  £  (0,  1)  it  follows  that 

Q00  =  G0*)-Q0i.  0  +  GG*.  0-Q(i.  0+0(1.  0 

a 00*.  O-OU.  0  +  00.  0 

which  implies,  for  arbitrary  x  €  K", 

xrQG*)jr;»jrr[O0*.  0-0(1.  0]*+xrQ(l,  t)x. 

Thus,  by  continuity  of  Q(fi,  t)  in  ft, 

lim  x7‘QG0*axrQ(l,  t)x,  x  €  Jt".  (5.17) 

Now,  since  A(l)  is  not  asymptotically  stable  and  (A(  1),  /„)  is 
stabilizable,  it  follows  from  (37,  Proposition  3.2,  p.  67]  that  for 
some  j?  €  H", 

lim  :?rQ(l,  t)X=  <». 

I— OB 

Thus,  by  (5.17) 

IimXrQO)jf=oo 

)i-l 

and  thus 

__  lim  ||Q0*)||f=o°-  (5-18) 

M— 1 

However,  (5.18)  contradicts  (5.16).  Hence,  (3.1)  is  robustly 
stable  over  3  and  0. 

To  derive  (5.12)  note  that  since  R  is  block  diagonal. 


J(G,  8)  =  2  tr  0.* .  =  2  (vcc  T  vec  R‘ 

i- I  /»l 

where  Q  satisfies  (3.7).  Furthermore,  (4.19)  implies 
vec  Q^-lAtf)  »  A, (8)]-' 


[ 


vec  y,+  2  vec  (G,kQkrr  Q,kG]k)  . 

k  ■  I  J 


Hence,  using  Lemma  2.1, 


J(G,6)  =  j£  tr((5,«0/?,) 

1*1  L 

+  2  (vec  [G,*0*.  +  0.*C[J)r  vec  fl(«)J 

=  2  tr  (£, (*)*,)  +  2  tr  Pm(GikQki+Q,kGTik) 
i»l  L  km |  J 

*2  I  tr  (&(»)*,) 

/•I  L 


*-l 


*] 


:2  tr(6(tf)/f, 

L 

:  2  ^tr  (0,«0*, 


)  +  2  (tr  /5((0))  2  <’«~(Gik)<JmalQk<) 


km  I 


] 


)  +  2(tr /*,(*))  2  "~(G*)IIQ*If 


Hence,  by  (4.8),  (5.15)  implies 

IO0»)«r-||40*>li^llftHf.»‘  €  (0,  1). 


(5.16) 
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f-l  L 


«3/(8)^,)  +  2(tr /*,(«))  2 
*-  1 


[tr  (Gtfm  +  2  (tr  A(8))(S^)(,.„] 

i-l 


where  i\  wi,  <u2  &  0.  Furthermore,  let  0  =  {?}  and 

s-U «] 

which  denotes  the  fact  that  the  local  subsystem  (oscillator) 
dynamics  are  assumed  to  be  known.  Since 


which  yields  (S.  12). 


□ 


a^{Aj  ®  A,)  =  [4«>2  +  (wy-«i)*] 1/2 


VI.  Examples 

We  Erst  confirm  that  the  damped  harmonic  oscillator  is 
asymptotically  stable  for  all  constant  frequency  perturbations. 
Hence,  let 

r=  1,  n  =  /i|  =  2 


and 


define 

["  2v  [4pj  +  («i-&)2)2]i/2] 

|_[4pj  +  (wi-«2)j],/2  2v 

Letting  V  =  /4  yields  V  =  2 /2.  Solving  (5.1)  yields 

5.(1.!)  =  (2  V2S-  y 12721  +  y\1)/2\2v(v1$-  >|2y2i), 

5.0.2)  =  (>12  +  72i)/2'i2(v*S-  yi272\), 

5(2,2)  =  (2v1S-  7)272)  +  72,)/2n/2K*'2^-  7)272)) 


where  v  >  0  and  <*>  €  83.  To  represent  frequency  uncertainty  let  3 
«  {0},  0  «  »,  6  =  0,  and 

>l(*)^  +  *[_;  j]. 

Note  that  A  (8)  is  stable  for  all  8  €  Ji  with  poles  -  v  ±  j(u  +  8). 
Note  that  >1(8)  can  be  diagonalized  by  means  of  the  unitary 
transformation 


so  that 


where 


Js[l+6!]l!,«s  (u,-u2)/2«'. 

Clearly,  §,  is  nonnegative  if  and  only  if 

7)272)  <»2G-  (6.1) 

The  bound  (6.1)  characterizes  the  magnitude  of  coupling  uncer¬ 
tainty  for  which  stability  is  guaranteed.  Note  that  the  parameter  5 
is  a  measure  of  the  frequency  separation  of  the  oscillators  relative 
to  the  damping.  When  <5  >  1 .  (6. 1 )  becomes  asymptotically 


7)2721  <2  l“l-«2l 


(6.2) 


Hence,  using 

>1(8)  «  >1(8) *  (<t>- 1  ®  e  A  (0  )){<)>  ®  <f>) 

it  follows  that 


<rnun(<4(8)  ®  A(6))  =  2p,  6  €  71. 

Defining  [see  (4.15)] 

a  =  «(i.i)=2v 

and  9  =  0,  the  scalar  majorant  Lyapunov  equation  (5.1)  has  the 
solution 


where  V  =  jj  V\\  F.  Choosing  V  =  I2  and  noting  that  !h  =  &  =  2v 
>  0  is  an  M  matrix,  Theorem  5.1  guarantees  robust  stability  for 
all  frequency  variations  8  €  33. 

The  next  example  has  been  chosen  to  demonstrate  the  robust¬ 
ness  of  a  pair  of  nominally  uncoupled  oscillators  with  respect  to 
uncertain  coupling.  Hence,  let 

n  =  4,  /•=  2,  n,  =  /t2  =  2 


and 


—  V 


l-  1,  2 


which  confirms  the  intuitive  expectation  that  robust  stability  is 
proportional  to  damping  and  subsystem  frequency  separation. 
This  result  does  not  appear  to  be  predictable  from  quadratic  or 
vector  Lyapunov  functions. 

To  evaluate  the  conservatism  inherent  in  the  bound  (6.1)  we 
solve  for  the  actual  stability  region.  To  render  the  calculation 
tractable  we  assume  that  C)2  and  G2i  have  the  structured  form 


By  constraining  (6.3)  the  set  of  coupling  variations  is  reduced, 
which  may  or  may  not  lead  to  a  larger  stability  region.  Thus,  our 
estimate  of  conservatism  may  itself  be  conservative,  i.e.,  the 
actual  conservatism  may  indeed  be  less  than  the  following 
analysis  indicates.  However,  without  (6.3)  the  development 
becomes  intractable.  This  calculation  will  thus  be  called  semiex- 
act. 

By  considering  the  characteristic  equation  for  A  +  C,  lengthy 
manipulation  shows  that  A  +  C  is  stable  if  and  only  if 

7)272)  < 2v\ -  «  +  [1  +  62(1  -  « 2)]  1/2)/(l  - 12)  (6.4) 

where  t  €  (0,  1]  is  the  smallest  positive  real  root  of 

« -0  +«J)[1  +«2(1  -f*)l,'1/[2  +  8*(l  -«*)].  (6.5) 


The  majorant  bound  (6.1)  and  semiexact  bound  (6.4)  are 
illustrated  in  unified  form  in  Fig.  1.  For  6  >  1  note  that  e  - 
0(6*')  and  thus  (6.4)  becomes  asymptotically 


7l2721<»’l«|-"2l- 
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On  the  other  hand,  the  semiexact  calculation  yields 

•Li*  +  +  +  ~X2)]/ 

[2^-4pi2Pj|\  —  2S(pnPii)1(l  —  X2)]}.  (6.8) 

Fig.  2  compares  the  semiexact  worst-case  performance  (6.8)  to 
the  majorant  Lyapunov  equation  bound  (6.7).  To  efficiendy 
illustrate  the  results  the  data  are  specialized  to  the  case  pl2  =  p:i. 
Note  that  the  semiexact  performance  is  plotted  for  several  values 
of  6  because  of  the  explicit  dependence  of  (6.8)  on  S  via  S. 
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Robust,  Reduced-Order,  Nonstrictly  Proper  State 
Estimation  Via  the  Optimal  Projection  Equations 
with  Guaranteed  Cost  Bounds 

WASSIM  M.  HADDAD  and  DENNIS  S.  BERNSTEIN 

Abstract — A  state-estimation  design  problem  involving  parametric 
plant  uncertainties  is  considered.  An  estimation  error  bound  suggested  by 
multiplicative  white  noise  modeling  is  utilized  for  guaranteeing  robust 
estimation  over  a  specified  range  of  parameter  uncertainties.  Necessary 
conditions  which  generalize  the  optimal  projection  equations  for  reduced- 
order  stale  estimation  are  used  to  characterize  the  estimator  which 
minimizes  the  error  bound.  The  design  equations  thus  effectively  serve  as 
sufficient  conditions  for  synthesizing  robust  estimators.  Additional 
features  include  the  presence  of  a  static  estimation  gain  in  conjunction 
with  the  dynamic  (Kalman)  estimator  to  obtain  a  nonstrictly  proper 
estimator. 


I.  INTRODUCTION 

As  is  well  known  [I]— [12].  the  performance  of  optimal  filters  based 
upon  nominal  parameter  values  may  be  severely  degraded  in  the  presence 
of  parameter  deviations.  Thus,  it  is  desirable  to  obtain  robust  state 
estimators  which  provide  acceptable  performance  over  the  range  of 
parametric  uncertainty.  The  approach  of  the  present  paper  is  related  to  the 
guaranteed  cost  approach  developed  for  control  in  [13],  [14]  and  applied 
to  estimation  in  [3].  Specifically,  the  main  idea  is  to  bound  the  effect  of 
the  uncertain  parameters  on  the  estimation  error  over  the  uncertainty 
range  and  then  choose  estimator  gains  to  minimize  the  estimation  bound. 
Thus,  the  actual  estimation  error  is  guaranteed  to  lie  below  the  prescribed 
upper  bound. 

The  technique  used  to  determine  minimizing  estimator  gains  is  a 
generalization  of  the  optimal  projection  equations  for  reduced-order  state 
estimation  [15],  Thus,  the  results  of  the  present  paper  effectively  extend 
the  results  of  [15]  to  the  case  of  parameter  uncertainties.  It  should  be 
noted  that  the  optimal  projection  equations,  which  are  necessary 
conditions  for  optimality,  now  serve  as  sufficient  conditions  for  robust 
estimation  by  virtue  of  the  fact  that  a  bound  on  the  estimation  error  is 
being  minimized  rather  than  the  estimation  error  itself.  The  bound  utilized 
in  the  present  paper  was  originally  suggested  by  multiplicative  white  noise 


Manuscript  received  June  8.  1987;  revised  September  25.  1987  This  work  was 
supported  in  part  by  the  U  S  Air  Force  Office  of  Scientific  Research  under  Contract 
F49620-86-C  *0002 . 

W  M  Haddad  is  with  the  Department  of  Mechanical  Engineering.  Florida  Institute  of 
Technology.  Melbourne.  FL  32901 

D.  S  Bernstein  is  with  the  Government  Aerospace  Systems  Division.  Hams 
Corporation.  Melbourne.  FL  32902 
IEEE  Log  Number  8718565 

ilSOI.OO  ©  1988  IEEE 


592 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL.  VOL.  33.  NO.  6,  JUNE  1988 


modeling  and  was  used  in  [16]-[18]  for  constructing  Lyapunov  functions 
for  robust  fixed-order  dynamic  compensation.  A  similar  bound  was  used 
for  full-state  feedback  in  [19]. 

An  additional  feature  of  the  present  paper  is  the  inclusion  of  a  static 
feedback  gain  in  conjunction  with  the  dynamic  estimator.  Thus,  the 
results  of  the  present  paper  represent  a  generalization  of  standard  results 
to  the  case  of  nonstrictly  proper  estimation.  Similar  treatments  in  the 
context  of  multiplicative  noise  models  were  given  in  [10]  and  [11]  for 
discrete-time  and  continuous-time  systems,  respectively. 

n.  Notation  and  Definitions 
Note:  All  matrices  have  real  entries. 


the  state-estimation  error  criterion 
J(A„  B„  C„  D.)  A  sup 

lim  sup  I[Lx(f)-y,(f)]r/nZJt(f)->,(0]  (3.6) 

f~m 

is  minimized. 

For  each  estimator  (A„B„  C„  D.)  and  system  variation  (A A ,  AC)  € 
*U,  the  disturbed  augmented  system  (3.1H3.S)  is  given  by 

i(r)*U+A/f)J(r)+w(r),  r€[0,  od)  (3.7) 

where  i(t )  A  (x7’(f),  Jrj'(f)]7'  and  1 5(0  has  intensity  P  €  Sa*.  The  cost 
can  be  expressed  in  terms  of  the  second-moment  matrix. 


»,  or*’, 

/„(  )r.  I 

©,  ® 

8',  S9',  J>' 

2i  s  Z2,  Z 1  <  Zj 

n,  /,  f,  n„  p,  q;  A 
y,  9,  y„  x„  X 
A,  A  A;  C,  AC 

C 

A„  B„  C„  D. 


A ,  A  A 


L,  R 


Real  numbers,  r  x  s  real  matrices,  B,xl. 
r  x  r  identity  matrix,  transpose,  expected  value. 

Kronecker  sum,  Kronecker  product  [20], 
r  x  r  symmetric,  nonnegative-definite,  positive-definite  matrices. 

Z2  -  Z,  €  M',  Zj  -  Z,  6  J>',  Z„  Z2  €  8'. 

Positive  integers;  n  +  n,. 
n,  l,  f,  q,  n.,  ^-dimensional  vectors. 
n  x  n  matrices;  l  x  n  matrices. 
t  x  n  matrix. 

n,  x  n,,  n,  x  l,  q  x  nt,  q  x  f  matrices. 

[A  0  1  I*  AA  0  "I 
B.C  A.j  ’  [_B,AC  Oj  ‘ 
q  x  n  matrix,  estimation-error  weighting  in  iP* . 

[LTRL-L TRD.C-  CTD*RL  +  CTDTtRD.C  - L  TRC.+  CTDJRC. 
-  C]RL  +  C]RD,C  C^RC. 


H-l(').  Wj(  ) 

y„  Vi 

y,2 


n,  /-dimensional  white  noise. 

Intensity  of  *,(•),  Wj(-);  V\  6  H",  P2  €  IP'. 
Cross  intensity  of  »*>,(•),  Wj(-). 


*(•).  p 

r  w,( )  I  r  y,  vnB]  I 

B.y2Bj J 

a 

Positive  number. 

a, 

Positive  number,  i  =  1,  •  ,  p 

0, 

Real  number,  i  =  1,  •  •  • ,  p. 

7, 

a'/a,  i  *  1 ,  •  ■  • ,  p. 

Aa  f  A.(a 

A  +  (a/2 )/„,  A.  +  (a/2)/v. 

[A.  o'] 

Aa 

L  B.C  A. J 

III.  Robust  Estimation  Problem 

Let  H  C  81"*"  x  (/^“"denote  the  set  of  uncertain  perturbations  (A A, 
AQ  of  the  nominal  plant  matrices  A  and  C. 

Robust  Estimation  Problem:  For  fixed  n,  s  n,  determine  ( A ,,  B,, 
Cf,  D ,)  such  that,  for  the  system  consisting  of  the  nth-order  disturbed 
plant 

x(r)  =  (A  +  AA).r(r)  +  w^t).  t  €  [0.  od),  (3.1) 


Proposition  3.1:  For  given  (A.,  B„  C„  D.)  and  (AA,  AO  €  *U,  the 
second-moment  matrix 

QsAit)  ft’£|i<OJ?r(f)].  I  €  [0,  00)  (3.8) 

satisfies 

Q*aU)-iA+bA)&aio+&auxA+bA)t+p,  1  e  jo.  »>. 

(3.9) 


noisy  and  nonnoisy  measurements 

‘  >>(/)*(C+ AC)Jt(/)  +  Wj(/), 

9(t)‘Cx{t), 

and  n,th -order  nonstrictly  proper  state  estimator 
X.(t)*Arx.(t)  +  B.y(t), 
y.O)-Cpc.(t)+D,f(t). 


Furthermore, 


(3.2) 

(3.3) 


(3.4) 

(3.5) 


J(A„  B„  C„  D.)  A  sup  lim  sup  t r  Q^(t)R.  f3  ,0) 

liA.SCI  611  l-m 

IV.  Sufficient  Conditions  for  Robust  performance 
The  following  result  is  immediate. 

Lemma  4. 1:  Suppose  A  +  A A  is  stable  for  all  (AA ,  AO  €  'll.  Then 
J(A,,  B,,  C,,  £>,)»  sup  tr  (4.1) 

(iA.AOCli 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL,  VOL.  33.  NO.  6.  JUNE  1988 


593 


where  $A/f  G  S3  *  is  the  unique  solution  to 

0*‘(A+aA)Q±a+Q&a{A  +  aA)t+P.  (4.2) 

We  seek  upper  bounds  for  J(A„  B„  C„  De). 

Theorem  4.1 :  Let  0:53''  x  -  8"  be  such  that 

(AA.  AC)  G  *U, 

A/lft  +  ftA/lrsQ(ft,  B ,),  (Q,.  B ,)  €  SS*XR"»»'  (4.3) 

and,  for  given  (A,,  B,,  C„  De),  suppose  there  exists  ft  G  53 11  satisfying 

0=/lft+ft/lr+Q(ft,  B,)+  P,  (4.4) 

and  suppose  the  pair  (P,/2,  A  +  AA)  is  stabilizable  for  all  (A/4,  AC)  G 
*U.  Then/4,  is  asymptotically  stable,  A  +  A A  is  asymptotically  stable  for 
all  (A/4,  AO  6  “U, 

5A/JSft.  (A/4,  AC)  G 'll  (4.5) 

where  satisfies  (4.2)  and 

J(A„  B„Ct,D,)&»  Q.R.  (4.6) 

Proof:  For  all  (A A,  AC)  €  'll,  (4.4)  is  equivalent  to 

0  =  (/f  +  A/f)ft+ft(/4+A/4)'  +  *(ft,  B„  A A)+  P  (4.7) 

where 

♦  (ft,  Bf.  A  A)  k  0(ft,  B,)-(A,lft+ftA/lr). 

Note  that  by  (4.3),  ♦(ft,  B„  A A)  a  0  for  ail  (AA,  AC)  G  'll.  Since 
(Pwl,  A  +  A/I)  is  stabilizable  for  all  (A/4,  AC)  6  'll,  it  follows  from 
(21,  Theorem  3.6]  that  ((P+  ♦(£).,  B„  aA))w1,  A  +  aA)  is  stabilizable 
for  all  (AA,  AC)  €  'll.  Hence.  (21,  Lemma  12.2]  implies  A  +  A  A  is 
asymptotically  stable  for  all  (AA,  AC)  €  'll.  Since  A  +  A/I  is  lower 
block  triangular.  A,  is  asymptotically  stable  and  A  +  A  A  is  asymptoti¬ 
cally  stable  for  all  (A/1,  AC)  €  Tl.  Next,  (4.7)  minus  (4.2)  yields 

0  =  (A  +  A/l)(ft-(2^)-t-(ft-<54^)(^  +  A/l)r+^{ft,  B„  A/I) 

or,  equivalently  (since  A  +  A  A  is  asymptotically  stable), 

ft-&/f=  (  e</,  +  ^>'+(ft,  B„  A/4)e(',*'u,r'  dlz.0, 

Jo 

which  implies  (4.5).  Finally,  (4.5)  and  (4.1)  yield  (4.6).  □ 

V.  Uncertainty  Structure  and  Guaranteed  Cost  Bound 
The  uncertainty  set  'll  is  assumed  to  be  of  the  form 

'll  a  1  (A/4,  AC)  6  •ll*’’*xM,**  :  AA  =  ^a,A,,  AC 

V  <-l 

« s«,c.  £•?/«?*  i|  (5.i) 

where,  for  /  *  1,  •  •  •,  p’.A,  G  ®',x"  and  C/  G  R'K"  are  fixed  matrices 
denoting  the  structure  of  the  parametric  uncertainty  in  the  dynamics  and 
measurement  matrices:  at  is  a  given  positive  number;  and  a,  is  an 
uncertain  real  parameter.  In  practice,  the  form  of  AA  and  AC  permits  the 
modeling  of  linear  parameter  uncertainties  of  arbitrary  structure.  Note 
that  the  uncertain  parameters  a,  are  assumed  to  lie  in  a  specified  ellipsoidal 
region  in  R”.  The  augmented  system  thus  has  structured  uncertainty  of  the 
form 

A  A'r'fraJ,  (5.2) 

i- 1 


where 


Remark  5.1:  Note  that  (5.1)  allows  a  particular  parameter  a,  to  appear 
in  both  A A  and  AC.  Thus,  it  is  possible  to  consider  the  case  in  which  the 
uncertainties  AA  and  AC  are  known  to  be  correlated.  Of  course,  for  a 
given  /,  A ,  or  C,  can  be  set  to  zero  so  that  the  similar  form  of  AA  and  AC 
represents  no  restriction. 

We  now  specify  the  bounding  function  0  satisfying  (4.3). 

Proposition  5.1:  Let  a  be  an  arbitrary  positive  scalar.  Then  the 
function 

Q(ft,  B.)  k  sft+a-'  £c|/|,ft/|T  (5.3) 

i-i 

satisfies  (4.3)  with  Tl  given  by  (5.1). 

Proof:  Note  that 


l(al/2o1/aj)/g-(a,/o(1'J)/l,)  •  ftl(al/3e,/a,)/l)-(ot1/al/2)/l,]r 


=<*  2  2  ofA/HAf  thU/ft* ft/47) 

!•  I  /-  I  »•  I 

which,  since  Sf.,  aj/atj  s  1,  implies  (4.3).  □ 

Remark  5.2:  Note  that  with  (5.3),  the  modified  Lyapunov  equation 
(4.4)  becomes 

0-*.ft+ei*:+£  Yi/lift/lf-E  p.  (5.4) 

/-I 

vi.  the  auxiuary  Minimization  Problem 

Our  goal  is  to  minimize  the  error  bound  (4.6). 

Auxiliary  Minimization  Problem:  Determine  (ft,  A„  Br,  C„  D,) 
with  ft  G  53  *  which  minimizes 

3(ft,  A,,  Bt,  C,,  D,)  k  tr  ft/?  (6.1) 

subject  to  (5.4)  and 

( Pul,  A  +  A/4 )  is  stabilizable,  (AA,  AC)  €  'll.  (6.2) 

Proposition  6. 1:  If  (ft,  At,Br.C„  Dr)  satisfies  (5.4)  and  (6.2)  with  ft 
a  0,  then  A  +  AA  is  asymptotically  stable  for  all  (A/4,  AC)  €  H  and 

,  J(A„  B„  C„  D,)s3(ft,  A„B„  C„  D,).  (6.3) 

Proof:  With  fl  given  by  (5.3),  Proposition  5. 1  implies  that  (4.3)  is 
satisfied.  Heme,  with  (6.2),  the  hypotheses  of  Theorem  4.1  are  satisfied 
so  that  the  system  (3.7)  is  stable  over  'll  with  estimation  bound  (4.6).  Note 
that  (6.3)  is  merely  a  restatement  of  (4.6).  □ 

Remark  6.1 :  The  conservatism  of  the  bound  (6.3)  is  difficult  to  predict 
for  two  reasons.  First,  the  overbounding  (4.3)  holds  with  respect  to  the 
partial  ordering  of  the  nonnegative-defmite  matrices  for  which  no  scalar 
measure  of  conservatism  is  available.  And  second,  the  bound  (4.3)  is 
required  to  hold  for  all  nonnegative-definite  matrices  ft  and  estimator 
gains  B,.  The  conservatism  will  thus  depend  upon  the  actual  values  of  ft 
and  B,  determined  by  solving  (5.4). 

vn.  necessary  Conditions  for  the  auxiliary  Minimization 
Problem 

Rigorous  application  of  the  Lagrange  multiplier  technique  requires 
additional  technical  assumptions.  Specifically,  we  further  restrict  (ft.  A,, 
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B„  C„  D,)  to  the  open  set 

Br»raK-‘, 

(7.6) 

8  A  {(ft.  A„  B„  C„  D,) :  ft  €  P*. 

C,-LixCT, 

(7.7) 

3  is  asymptotically  stable. 

D.nLQCT(CQCr)-\ 

(7.8) 

(A„  B,,  C ,)  is  controllable  and  observable,  and 
C(Q,-Q,tQl-'Q!i)CT>0) 

and  such  that  Q,  Q,  and  P  satisfy 

where 

0-A.Q+QAJ+  K.  +  j;  yiA.fQ  +  ^Aj- 
1-  1 

&  A  A.®  A. +2  T<Aj  ®  At 

l-l 

-OsVl'Ql+uQ.Vl'Q]^, 

(7.9) 

and  ft  is  partitioned  as 

o-a.Q+Ga:+q1v-Jqj-taq,vi'qJtI, 

(7.10) 

I 

I 

I 


where  Qu  Qn,  and  £>2  are  n  x  n,  n  x  n„  and  n,  x  n„  respectively.  As 
shown  in  [II],  Q2  is  invertible  since  (A„  B,)  is  controllable.  The 
definiteness  condition  holds  when  C  has  full  row  rank  and  ft  is  positive 
definite.  As  shown  in  [11],  this  condition  implies  the  existence  of  the 
projection  f  defined  below. 

Remark  7.1:  Proposition  6.1  shows  that  the  constraint  (ft,  A„  B„  C„ 
D,)  6  S  is  not  required  for  robust  estimation.  As  can  be  seen  from  the 
proof  given  in  [1 1],  the  set  S  constitutes  sufficient  conditions  under  which 
the  Lagrange  multiplier  technique  is  applicable  to  the  auxiliary  minimiza¬ 
tion  problem.  Specifically,  ft  €  (P*  replaces  ft  €  W*  by  an  open  set 
constraint,  while  asymptotic  stability  of  G  serves  as  a  normality  condition 
which  further  implies  that  the  dual  <P  of  ft  is  nonnegative  definite.  Thus,  it 
is  not  necessary  for  guaranteed  robust  estimation  that  an  admissible 
quadruple  obtained  by  solving  the  necessary  conditions  actually  be  shown 
to  be  an  element  of  S. 

The  following  factorization  lemma  is  needed  for  the  statement  of  the 
main  result.  For  details,  see  [15], 

Lemma  7.1:  If  Q,  P  €  S3"  and  rank  QP  m  n„  then  there  exist  n,  x 
nC,  T,  and  n,  x  n,  invertible  M  such  that 

QP=GtMT  (7.1) 

rGr=/„,.  (7.2) 

Recall  from  [15]  that 

r  St  CP(0P)‘  =  CT T  (7.3) 

is  an  oblique  projection.  Define  the  complementary  projection  t l  A  1„  - 
t  and  call  (C,  M,  T)  satisfying  (7.1),  (7.2)  a  projective  factorization  of 
QP.  Furthermore,  for  arbitrary  Q,  Q  £  iR"x",  define  the  notation 


Vi,  &  +  2  7,C,iQ+C)CJ. 


a  g  gcN-K.,+2 14AQ+&C*. 

Theorem  7.1:  If  (ft,  A„  B„  C„  £>,)  6  8  solves  the  auxiliary 
minimization  problem  with  11  given  by  (3.1)  and  0  given  by  (3.3),  then 
there  exist  Q,Q,PG.  W  *  such  that,  tor  some  projecuve  factorization  (C, 
M,  T)  of  QP,  (ft,  A„  B„  C„  D,)  are  given  by 

mm\Q+0  <2rr  1 

81  [  r$  rtfr'J  1 

A.~T(A-Q.V'JC)GT, 


(7A) 

(7.3) 


G=(A.-Q,Vl''C)TP+P(A'-Q,Vl'C) 

+  tt1LtRLtj.-tt1tTLtRLt_t.,  (7.11) 
rank  <3  =  rank  P=  rank  CP- nr  (7.12) 

where 

f  A  QCr{CQCTr'C,  r\  A  1,-r.  (7.13) 

Furthermore,  the  auxiliary  cost  is  given  by 

3(«L  A„  B„  C„  D,)-tr  QrWRLf.  ■  (7.14) 

Conversely,  if  there  exist  Q.Q.P  6  S3"  satisfying  (7.9)-(7- 12),  then  (ft, 
A„  B„  C„  Dr)  given  by  (7.4H7.8)  satisfy  (5.4)  with  ft  G  M*  and  with 
9  (ft.  A„  B„  C,,  Dr)  given  by  (7.14). 

Proof:  The  derivation  requires  only  a  minor  modification  of  the 
derivation  given  in  [11].  The  only  change  involves  treatment  of  Aa  in 
place  of  A.  □ 

Remark  7.1:  The  necessary  conditions  given  in  Theorem  7.1  directly 
generalize  the  result  given  in  [15].  To  recover  the  result  of  [15],  set  A,  * 
0,  C,  =  0,  i  =  1 ,  •  •  • ,  p  (to  delete  the  plant  uncertainties),  and  set  C  =  0 
(to  eliminate  the  static  estimation  term  Dt).  It  follows  from  the  proof 
given  in  [11]  that  C  =  0  yields  f  =  0,  and  thus  t±  =  /„. 

Remark  7.2:  Note  that  ft  given  by  (7.4)  is  nonnegative  definite. 

vni.  Sufficient  Conditions  for  Robust,  Reduced-Order 
Estimation 

The  main  result  guaranteeing  robust  estimation  can  now  be  stated. 
Theorem  8.1:  Suppose  there  exist  Q,  Q,  P  €  t'J'  satisfying  (7.9)- 
(7. 12),  let  A„  B„  C„  D,  be  given  by  (7.5)-(7.8),  and  suppose  that  ( i”2, 
A  +  AA)  is  stabilizable  for  all  (A A,  AC)  €  11  with  11  given  by  (5.1). 
Then  A,  is  asymptotically  stable,  A  +  A  A  is  asymptotically  stable  for  all 
(A A ,  AC)  €  H,  and  the  estimation  error  satisfies  the  performance  bound 

J(A„  B„  C„  D,)S tr  Qi\LTRLri .  (8.1) 

Proof:  Theorem  7. 1  and  Remark  7.2  imply  that  ft  given  by  (7.4)  is 
nonnegative  definite  and  satisfies  (5.4).  With  the  stabilizability  assumption, 
the  result  follows  from  Proposition  6.1.  □ 

Remark  8.1:  Suppose  f  =  n,  C  =  /„  (so  that  perfect  measurements  of 
the  entire  state  are  available),  and  Q  satisfying  (7.9)  is  positive  definite. 
Then  it  follows  from  Theorem  7. 1  that  f  =  f  x  «*  0,  C,  *  0  (i.e.,  the 
dynamic  filter  is  disabled),  Dr  «  L,  and  by  (8.1),  7  «=  0.  This  is.  of 
course,  the  expected  result  since  perfect  estimation  is  achievable  in  this 
case. 


REFERENCES 

(1]  J.  A.  D’Appoiito  and  C.  E.  Hutchimon.  "Low  sensitivity  filler*  for  aw 
estimation  In  the  pretence  of  larje  parameter  uncertainties.  "  IEEE  Trent. 
Automat.  Contr.  vol.  AC-14,  pp.  310-312.  1969. 

(2|  P.  J.  McLane.  "Optimal  linear  filterini  for  linear  systems  with  Kate-dependent 
noise,"  lat.  J.  Contr.,  vol.  10.  pp.  41-51.  1969. 

(31  B.  N.  Jain,  "Guaranteed  error  estimation  in  uncertain  systems."  IEEE  Trans. 
Automat.  Contr..  vol.  AC-20,  pp.  230-232,  1973. 


I 

I 


I 

I 

I 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL.  VOL.  33.  NO.  6.  JUNE  1988 


595 


(4)  R.  C.  Chung  and  P.  R.  Belanger.  "Minimum-sensitivity  filter  for  linear  time- 
invariant  stochastic  systems  with  uncertain  parameters."  IEEE  Trans.  Automat. 
Contr..  vol.  AC-21,  pp.  98-100.  1976. 

(3|  K.  Furuta.  S.  Han.  and  S.  Mori,  "A  class  of  systems  with  the  same  observer." 

IEEE  Trans.  Automat.  Contr.,  vol.  AC-21,  pp.  572-J76,  1976. 

(61  S.  P.  Bhattacharyya.  “The  structure  of  robust  observers,"  IEEE  Trans. 

Automat.  Contr.,  vol.  AC-21,  pp.  381-388.  1976. 

[7|  M.  Toda  and  R.  V.  Patel,  "Bounds  on  estimation  errors  of  discrete-time  filters 
under  modeling  uncertainty,"  IEEE  Trans.  Automat.  Contr.,  vol.  AC-23,  pp. 

1 1 15-1 121.  1980. 

18]  R.  T.  Stefani.  "Reducing  the  sensitivity  to  panmeter  variations  of  a  minimum- 
order  reduced-order  observer,"  Int.  I.  Contr.,  vol.  33,  pp.  983-995,  1982. 

(9)  T.  E.  Djaferia,  "Robust  observers  for  systems  with  parameters,"  Syst.  Contr. 
Lett.,  vol.  7,  pp.  385-394,  1986. 

(10)  W.  M.  Haddad  and  D.  S.  Bernstein,  “The  optimal  projection  equations  for 
discrete-time  reduced -order  state  estimation  for  linear  systems  with  multiplicative 
white  noise.”  Syst.  Contr.  Lett.,  vol.  8.  pp.  381-388.  1987. 

|ll]  - .  "The  optimal  projection  equations  for  reduced-order  state  estimation:  The 

singular  measurement  noise  case,"  IEEE  Trans.  Automat.  Contr.,  vol.  AC-32, 
pp.  1135-1139.  1987. 

1 1 2]  D  S.  Bernstein  and  D.  C.  Hyland,  "The  optimal  projection  equations  for  reduced- 
order  modelling,  estimation  and  control  of  linear  systems  with  multiplicative  white 
noise."  J  Optimil.  Theory  Appl..  to  be  published. 

|13|  S.  S.  L.  Chang  and  T.  K.  C.  Peng,  "Adaptive  guaranteed  cost  control  of  systems 
with  uncertain  parameters."  IEEE  Trans.  Automat.  Contr..  vol.  AC-17,  pp. 
474-483,  1972. 

(14)  A.  Vinkler  and  L.  i.  Wood.  "Multistep  guaranteed  cost  control  of  linear  systems 
with  uncertain  parameters."  J.  Guidance  Contr.,  vol.  2.  pp.  449-456.  1979. 

( 15)  D.  S.  Bernstein  and  D.  C.  Hyland,  “The  optimal  projection  equations  for  reduced- 
order  sate  estimation.”  IEEE  Trans.  Automat.  Contr.,  vol.  AC-30,  pp.  583- 
585.  1985. 

(16)  D.  S.  Bernstein  and  S.  W.  Greeley.  "Robust  output-feedback  stabilization: 
Deterministic  and  stochastic  perspectives,"  in  Proc.  Amer.  Contr.  Con/., 
Seattle.  WA.  June  1986.  pp.  1818-1826. 

(17)  W.  M.  Haddad.  "Robust  optimal  projection  control-system  synthesis."  Ph.D. 
dissertation.  Dept.  Mech.  Eng.,  Florida  Inst.  Techno). ,  Melbourne,  Mar.  1987. 

(18)  D.  S.  Bernstein.  “Robust  sutic  and  dynamic  output-feedback  stabilization: 
Deterministic  and  stochastic  perspectives,"  IEEE  Trans.  Automat.  Contr.,  vol. 
AC-32,  pp.  1076-1084.  1987. 

(19)  O.  I.  Kosmidou  and  P.  Bertrand.  “Robust-controller  design  for  systems  with  large 
parameter  variations,"  Int.  J.  Contr.,  vol.  45.  pp.  927-938.  1987. 

t20|  j.  W.  Brewer,  “Kronecker  products  and  matrix  calculus  in  system  theory,"  IEEE 
Trans.  Circuits  Syst..  vol.  CAS-25.  pp.  772-781,  1978. 

(21)  W.  M.  Wortham,  Linear  Multivariable  Control:  A  Geometric  Approach. 
New  York:  Springer-Verlag.  1979. 


Approximate  and  Limit  Results  for  Nonlinear  Filters 
with  Small  Observation  Noise:  The  Linear  Sensor 
and  Constant  Diffusion  Coefficient  Case 

OFF.R  ZEITOUNI 

Abstract — Recursive  approximations  for  a  class  of  filtering  problems 
are  presented.  This  class  is  characterized  by  linear  observation  sensor, 
constant  diffusion  terms,  and  for  the  multidimensional  problem,  poten¬ 
tial-like  conditions  on  the  drift.  For  the  case  of  small  observation  noise, 
these  approximations  are  used  to  demonstrate  the  Gaussian  limiting 
structure  of  the  optimal  nonlinear  filter. 

1.  INTRODUCTION 

The  classical  nonlinear  Filtering  problem  is  of  the  form 

dx,=f(x,)d/  +  o(x,)dwl,xl  e  tf,  p(x„)-po(xo)  (1-1) 

dy,v‘g(xl)dt  +  N'll/2del.yl  €  K",  y„-0  (1.2) 
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where  w„  9,  are  independent  Brownian  motions  and  the  filtering  problem 
consists  of  computing  statistics  of  x,  when  the  observation  o  algebra  y'0  & 
{>„  0  <  s  <  /}  is  given.  By  now,  it  ip  clear  that  for  all  but  a  few 
problems,  an  explicit  final  dimensional  solution  does  not  exist  [4J. 
Therefore,  one  is  led  to  consider  approximations  and  to  consider 
simplified  limiting  cases.  Especially,  the  low  observation  noise  case  (No 

0)  has  been  considered  in  the  literature  [3],  (6],  [11], 

In  this  paper,  we  restrict  out  attention  to  the  special  case  of  linear 
observations  and  constant  diffusion  coefficients,  i.e., 

dx,*f(x,)dt+odw„x,  €  R',  P(Xe)~p0(x<>)  (1.1') 

dy,-gx4‘JrN))nd6„  y,  €  Hr,  y0= 0  (1.2') 

where  o,  g  are  matrices  of  appropriate  dimensions.  In  the  multidimen¬ 
sional  case,  we  impose  some  additional  potential-like  structural  conditions 
on/)-).  For  this  restricted  class  of  filtering  problems,  we  derive  recursive 
approximations  to  the  conditional  density  px,(z\y1)  and  to  its  unnormalized 
version  px,(z\y%  For  the  limiting  case  N0  -»  0,  those  approximations  are 
used  to  show  that  the  conditional  density,  rescaled  in  a  suitable  manner, 
converges  to  a  Gaussian  density,  with  tight  estimates  on  the  "tails"  of  the 
density.  This  fact  demonstrates  the  usefulness  of  Gaussian-based  approxi¬ 
mations  (like  the  extended  Kalman  filter  or  the  second-order  Gaussian 
filter). 

Related  results  were  obtained  by  Mayer-Wolf  [9]  in  his  dissertation. 
There,  bounds  on  the  filtering  error  and  the  Cramer-Rao  inequality  are 
used  to  prove  a  basic  Gaussian  limit  result,  although  under  different 
assumptions. 

The  paper  is  organized  as  follows.  The  one-dimensional  problem  (n  = 
m  *=  I)  is  treated  in  Sections  Q  and  m.  In  Section  n,  we  present  our  basic 
approximation  theorem,  which  holds  whether  No  is  small  or  not.  We 
farther  demonstrate  that,  if  N0  -*  0  the  approximations  exhibit  certain 
nice  limiting  behavior,  then  the  rescaled  conditional  density  converges 
(weakly  and  pointwise)  to  a  Gaussian  density.  In  Section  m,  we  check  out 
explicidy  the  limiting  behavior  of  the  approximations  and  derive  explicit 
conditions  on  /(■)  under  which  the  density  indeed  converges  to  a  Gaussian 
one.  Finally,  in  Section  IV,  we  extend  our  results  to  a  class  of 
multidimensional  problems. 

We  make  throughout,  the  following  assumption. 

(Al)  Jl')  is  continuously  differentiable  with  bounded  first  partial 
derivatives. 

II.  AN  APPROXIMATION  THEOREM— THE  ONE-DlMENSlONAL  CASE 

In  this  section,  an  approximation  theorem  for  the  unnormalized 
conditional  density  p(z\y$  is  presented.  Throughout,  the  one-dimensional 
case  is  treated.  Multidimensional  extensions  are  postponed  to  Section  IV. 

Without  loss  of  generality,  we  assume  a  =  1  in  (1.1').  Recall  that 
under  (A-l),  a  solution  to  (1.1')  exists  and  is  unique.  Moreover,  the 
measure  Pt  defined  by  the  pair  (1.1 '),  (1.2')  is  absolutely  continuous 
w.r.t.  the  reference  measure  PB  defined  by 

dx,  =  otx,dt  +  dw„  p(x<,)=pn(x„)  (2.1) 

dy,~N'*de„  y0= 0  (2.2) 

where  a  is  some  constant  to  be  defined.  The  Radon-Nikodym  derivative 
dP,/dP0  is  18). 

^  =  exp  ^  ^  (J(x,)-ax ,)  dx,- >/2  ^  WHx,)- alx])  ds 

+  N;'gx,  dy,- '/j  Nj'g'x)  dsj  .  (2.3) 

As  is  well  known  (2),  [12],  [13],  the  unnormalized  conditional  density 
Piz\y°)  satisfies 

p(z\y't)  *  ^  |*r  O-4) 
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Abstract 

A  feedback  control-design  problem  involving  structured  real- valued  plant  parameter  uncertain¬ 
ties  is  considered.  Two  robust  control-design  issues  are  addressed.  The  Robust  Stability  Problem 
involves  deterministic  bounded  structured  parameter  variations,  while  the  Robust  Performance 
Problem  includes,  in  addition,  a  quadratic  performance  criterion  averaged  over  stochastic  distur¬ 
bances  and  maximized  over  the  admissible  parameter  variations.  The  optimal  projection  approach 
to  fixed-order  dynamic  compensation  is  merged  with  the  guaranteed  cost  control  approach  to  robust 
stability  and  performance  to  obtain  a  theory  of  full-  and  reduced-order  robust  control  design.  The 
principal  result  is  a  sufficient  condition  for  characterizing  dynamic  controllers  of  fixed  dimension 
which  are  guaranteed  to  provide  both  robust  stability  and  performance.  The  sufficient  conditions 
involve  a  system  of  modified  Riccati  and  Lyapunov  equations  coupled  by  an  oblique  projection,  i.e., 
idempotent  matrix,  as  well  as  the  uncertainty  bounds.  Finally,  in  contrast  to  the  usual  separated 
Riccati  equations,  the  full-order  result  involves  a  coupled  system  consisting  of  two  modified  Riccati 
equations  and  two  modified  Lyapunov  equations  coupled  by  the  uncertainty  bounds.  The  coupling 
illustrates  the  breakdown  of  the  separation  principle  for  LQG  control  with  real- valued  structured 
plant  parameter  variations. 
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1.  Introduction 


The  direct  method  of  Lyapunov  has  proven  to  be  an  effective  approach  to  robust  analysis 
and  design  of  feedback  control  laws.  References  [Bl],  [B2],  [BCL],  [BG2],  [CL],  [CP],  [ER],  [GB], 
[H],  [KB],  [KBH],  [L],  [PH],  [TB],  [VW]  comprise  only  a  representative  collection  of  the  increasing 
literature  in  this  area.  In  performing  robust  synthesis  there  are  two  principal  issues,  namely, 
stability  robustness  and  performance  robustness.  Stability  robustness  addresses  the  problem  of 
guaranteeing  stability  of  the  closed-loop  system  for  plant  perturbations  within  a  specified  class  of 
uncertainties.  In  addition  to  guaranteeing  robust  stability,  it  is  often  desirable  to  minimize  the 
worst-case  performance  degradation  within  a  given  robust  stability  range.  Although  both  robust 
stability  and  performance  are  of  interest  in  practice,  most  of  the  literature  involving  quadratic 
Lyapunov  functions  is  confined  to  the  problem  of  robust  stability.  A  notable  exception  is  the  early 
work  of  Chang  and  Peng  ([CP])  which  also  provides  bounds  on  worst-case  quadratic  performance 
within  full-state  feedback  control  design. 

The  contribution  of  the  present  paper  is  a  methodology  for  designing  controllers  which  provide 
both  robust  stability  and  robust  performance  over  a  prescribed  range  of  real-valued  structured 
plant  parameter  variations.  The  feedback  law  is  in  the  form  of  a  fixed-order  (i.e.,  full-  or  reduced- 
order)  strictly  proper  dynamic  compensator.  The  overall  approach  is  based  upon  the  merging  of 

two  distinct  control-design  techniques,  namely,  the  guaranteed  cost  control  approach  to  robust 

\ 

performance  ([CP])  and  the  optimal  projection  approach  to  fixed-order  dynamic  compensation 
([BH1],[HB]).  The  principal  motivation  for  our  approach  is  to  permit  greater  flexibility  in  the 
design  of  robust  feedback  laws  by  providing  an  alternative  to  full-state  feedback  and  full-order 
dynamic  compensation. 

The  guaranteed  cost  control  approach  ([CP])  adopted  in  the  present  paper  utilizes  a  perfor¬ 
mance  bound  to  provide  robust  performance  in  addition  to  robust  stability.  Here,  robust  perfor¬ 
mance  refers  to  a  guaranteed  bound  on  the  worst-case  value  of  the  expectation  of  a  quadratic  cost 
criterion  over  a  prescribed  uncertainty  set.  This  quadratic  criterion  is  precisely  the  standard  cost 
functional  of  linear-quadratic-Gaussian  control  theory.  By  bounding  the  worst-case  value  of  this 
criterion  over  a  specified  range  of  plant  uncertainties,  we  effectively  bound  the  variances  of  specified 
states  and  control  signals. 

To  bound  the  worst-case  closed-loop  performance,  we  require  a  bound  on  the  effect  of  plant 
uncertainties  on  the  steady-state  closed-loop  covariance  matrix.  The  form  of  the  guaranteed  cost 


1 


control  bound  utilized  herein  was  originally  motivated  by  the  effect  of  multiplicative  white  noise  on 
the  state  covariance  ([B2]),[BG2]).  Since  this  bound  is  differentiable  with  respect  to  the  covariance 
matrix  and  compensator  gains,  it  permits  optimal  design  via  first-order  necessary  conditions.  This 
approach  is  not  possible  using  the  nondifferentiable  bound  originally  proposed  in  [CP].  An  alterna¬ 
tive  differentiable  bound  proposed  in  [PH]  for  full-state  feedback  has  been  extended  to  fixed-order 
dynamic  compensation  in  [BH2] . 

In  the  present  paper,  the  guaranteed  cost  technique  is  used  to  bound  the  closed-loop  perfor¬ 
mance  and  characterize  robustly  stabilizing  controllers.  This  performance  bound  is  then  interpreted 
as  an  auxiliary  coat  which  is  to  be  minimized  by  the  choice  of  compensator  gains.  The  actual  per¬ 
formance  for  a  given  realization  of  the  parameter  uncertainty  is  thus  guaranteed  to  lie  below  this 
bound.  In  the  presence  of  a  stabilizability  (disturb ability)  assumption,  the  robust  performance 
bound  automatically  implies  robust  stability.  The  auxiliary  cost  and  the  Lyapunov  equation  con¬ 
straint  together  form  the  Auxiliary  Minimization  Problem.  Since  the  Auxiliary  Minimization  Prob¬ 
lem  is  a  nonconvex  mathematical  programming  problem  with  differentiable  data,  it  is  amenable  to 
first-order  necessary  conditions. 

One  feature  of  this  approach  is  that  since  the  necessary  conditions  are  obtained  for  the  Auxil¬ 
iary  Minimization  Problem  rather  than  the  original  problem,  extremals  are  guaranteed  to  provide 
both  robust  stability  and  performance.  Note  that  this  is  true  for  every  extremal  of  the  Auxiliary 
Minimization  Problem  whether  it  corresponds  to  a  local  minimum,  local  maximum,  or  otherwise. 
Of  course,  the  global  minimum  is  most  likely  to  provide  the  best  worst-case  performance  over  the 
robust  stability  range.  In  any  case,  necessary  conditions  for  the  Auxiliary  Minimization  Problem 
effectively  serve  as  sufficient  conditions  for  robust  stability  with  a  guaranteed  performance  bound. 

The  present  paper  encompasses  a  rigorous  development  of  sufficient  conditions  for  robust  star 
bility  and  performance  via  fixed-order  dynamic  compensation.  These  sufficient  conditions  are  in 
the  form  of  a  coupled  system  of  algebraic  matrix  equations  consisting  of  two  modified  Riccati 
equations  and  two  modified  Lyapunov  equations.  The  coupling  is  due  to  the  optimal  projection, 
which  characterizes  reduced-order  controllers,  and  the  uncertainty  bounds,  which  account  for  the 
effect  of  parameter  uncertainties  on  the  performance  functional.  When  the  compensator  order  is 
constrained  to  be  equal  to  the  dimension  of  the  plant  and  the  uncertainty  bounds  are  absent,  the 
equations  specialize  to  the  usual  pair  of  separated  Riccati  equations  of  steady-state  LQG  theory. 

We  are  quick  to  point  out,  however,  that  our  approach  is  constructive  in  nature  rather  than 
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existential.  That  is,  our  sufficient  conditions  provide  explicit  formulae  for  robust,  fixed-order  feed¬ 
back  gains  when  the  Auxiliary  Minimization  Problem  has  a  solution.  In  this  sense  our  constructive 
conditions  can  be  viewed  as  complementary  to  existential  results  on  robust  stabilizability.  Specif¬ 
ically,  the  existence  of  a  solution  to  the  Auxiliary  Minimization  Problem  and  associated  design 
equations  depends  upon  stabilizability  via  fixed-order  controllers  as  well  as  the  sharpness  of  the 
quadratic  Lyapunov  bounds.  The  stabilizability  problem  has  been  studied  using  independent  meth¬ 
ods  (see,  e.g.,  [BHK]),  while  the  conservatism  of  the  bounds  is  considered  in  [BH3].  In  addition, 
we  state  a  local  existence  result  for  solvability  of  the  design  equations  which  assumes  only  nominal 
stabilizability. 

The  contents  and  scope  of  the  paper  are  as  follows.  In  Section  2  we  state  the  robust  stability  and 
performance  problems  for  fixed-order  dynamic  compensation  with  plant  parameter  uncertainty.  In 
Section  3  a  modified  Lyapunov  equation  is  introduced  whose  solution,  when  it  exists,  is  guaranteed 
to  bound  the  steady-state  closed-loop  covariance  over  the  specified  range  of  plant  uncertainty.  A 
performance  bound  is  then  given  in  terms  of  the  covariance  bound.  In  Section  4  we  view  the 
performance  bound  as  an  auxiliary  cost  and  consider  the  problem  of  minimizing  the  auxiliary 
cost  subject  to  the  modified  Lyapunov  equation  and  a  definiteness  condition  as  side  constraints. 
These  side  constraints  have  the  property  that  all  admissible  elements  provide  robust  stability  and 
performance  (Proposition  4.1).  In  Section  5  the  uncertainty  set  and  bound  for  constructing  the 
modified  Lyapunov  equation  are  given  concrete  forms.  Specifically,  the  uncertainty  set  has  the  form 
of  an  ellipsoidal  region  in  parameter  space  while  the  modified  Lyapunov  equation  includes  additional 
linear  terms  to  bound  the  uncertainty.  A  sufficient  condition  involving  Kronecker  sums  and  products 
implies  the  existence  of  a  unique,  nonnegative-definite  solution  to  the  modified  Lyapunov  equation. 
Section  6  presents  the  first-order  necessary  conditions  (Theorem  6.1)  for  the  Auxiliary  Minimization 
Problem  under  minor  additional  technical  conditions  to  ensure  the  applicability  of  the  Lagrange 
multiplier  technique.  As  discussed  above,  these  necessary  conditions  are  in  the  form  of  extended 
optimal  projection  equations.  A  partial  converse  of  the  necessary  conditions  shows  that  solutions 
of  these  algebraic  equations  provide,  by  construction,  a  solution  of  the  original  modified  Lyapunov 
equation.  This  result  is  combined  in  Section  7  (Theorem  7.1)  with  a  stabilizability  assumption  to 
guarantee  robust  stability  with  a  robust  performance  bound.  In  addition,  we  state  an  existence 
result  for  local  solvability  of  the  design  equations  by  applying  a  result  from  [Rl],[R2]  (Theorem 
7.2).  To  draw  connections  with  standard  LQG  theory,  in  Section  8  we  specialize  Theorem  7.1  to 
the  full-order  case.  In  contrast  to  the  pair  of  separated  Riccati  equations  of  standard  LQG  theory, 
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the  full-order  result  in  the  presence  of  plant  parameter  variations' is  given  by  a  coupled  system 
of  four  modified  Riccati/Lyapunov  equations.  In  Section  9  the  theory  is  illustrated  by  means  of 
an  example  due  to  Doyle  ([D]).  This  problem  was  also  considered  in  [BG1]  before  the  robustness 
theory  developed  herein  was  available.  Hence  the  present  paper  can  be  viewed  as  the  rigorous 
mathematical  foundation  which  legitimizes  the  heretofore  ad  hoc  robustness  approach  of  [BGl]. 

Notation.  Note:  All  matrices  have  real  entries 


IR,  IRrx*,IRr,IE 

Jr,()T,Orx.,Or 

tr  Z 

®,  ® 

Sr,INr,IPr 
Z\  <  Z),  Z\  <  Z] 
n,m,Z,ne,p;  n 
x,u,y,xe,x 
A,  A  A;  B,AB 
C,  AC]  D,AD 
Aa  Be,Cc 
a 

Aa,  Aea 

li 

<r% 

Ri,Ri 

Rn 

R 

Vx,Va 

Vi» 

w(>),V 


real  numbers,  r  x  a  reed  matrices,  IRrXl,  expected  value 

r  x  r  identity  matrix,  transpose,  r  x  a  zero  matrix,  0rxr 

(i,j)-element  of  matrix  Z,  trace  of  square  matrix  Z 

Kronecker  sum,  Kronecker  product  ([B3]) 

r  x  r  symmetric,  nonnegative-definite,  positive-definite  matrices 

Zi  -  Zx  G  IN',  Z-x  -  Zx  G  lPr,  Zu  Z3  G  Sr 

positive  integers;  n  +  nc 

n, m, l, ne,  n-dimensional  vectors 

n  x  n  matrices;  n  x  m  matrices 

l  x  n  matrices;  l  x  m  matrices 

n„  x  ne,  ne  x  /,  m  x  n„  matrices 

positive  number 

A  +  ^In  I  Ae  +  f/n. 

positive  number,  $  =  1, . . . ,  p 

<**/<*> 

real  number,  *  =  1, . . . ,  p 

state,  control  weighting  matrices;  Rx  €  IN",  Rj  G  IP” 
n  x  m  cross-weighting  matrix;  f?x  -  RX3R3  lRjt  >  0 

i?i  R\iCc 
CJR&  CjR2Ce . 

n,  ^-dimensional  white  noise 

intensity  of  wx(-),u/j(-);  Vx  G  INn,V3  €  IP4 

n  x  t  croes  intensity  of 


Wx(-) 

'  Vx  V13BJ  ■ 

.SeWaO). 

> 

B.V&  B'VxBJ, 

4 


2.  Robust  Stability  and  Robust  Perfozmance  Problems 

In  this  section  we  state  the  Robust  Stability  Problem  and  Robust  Performance  Problem. 
Both  problems  involve  a  set  U  C  IRnx"  x  IR"*”1  x  IR*X"  x  IR*Xm  of  uncertain  perturbations 
(AA,AB,AC,AD)  of  the  nominal  system  matrices  (A,  B,C,  D).  The  goal  of  the  Robust  Stability 
Problem  is  to  determine  a  fixed-order,  strictly  proper  dynamic  compensator  (Ae,Be,Ce)  which 
stabilizes  the  plant  for  all  variations  in  U.  In  this  section  and  the  following  section  no  explicit  as¬ 
sumptions  are  required  for  the  set  U.  In  Section  5  the  structure  of  variations  in  U  will  be  specified. 

Robust  Stability  Problem.  For  fixed  ne  <  n  determine  (Ac,  Bc,Ce)  such  that  the  closed- 
loop  system  consisting  of  the  nth-order  controlled  plant 

i(t)  =  (A  +  AA)x(t)  +  (2?  +  AB)u(t),  t  €  [0,  oo),  (2.1) 

measurements 

y(i)  =  {C  +  AC)x(t)  +  [D  +  AD)u{t),  (2.2) 

and  n„th-order  dynamic  compensator 

xe(t)  =  Aexe(t)  +  Bey(t),  (2.3) 

u(i)  =  Cexe(t),  (2.4) 

is  asymptotically  stable  for  all  ( AA,AB,AC,AD )  €  U. 

The  Robust  Performance  Problem  involves,  in  addition,  white  plant  disturbances  and  measure¬ 
ment  noise.  The  goal  of  this  problem  is  to  determine  a  fixed-order,  strictly  proper  compensator 
(Ae,Be,Ce)  which  minimizes  the  worst-case  value  over  the  uncertainty  set  U  of  a  steady-state 
average  quadratic  performance  criterion. 

Robust  Performance  Problem.  For  fixed  ne  <  n,  determine  (A„,  Be,Ce )  such  that,  for  the 
closed-loop  system  consisting  of  the  nth-order  controlled  and  disturbed  plant 

*(t)  =  (A  +  AA)x{t)  +  (B  +  AB)u(t)  -I-  wi(f),  t  e  [0,  oo),  (2.5) 

noisy  measurements 

y{t)  =  (C  +  AC)x{t)  +  {D  +  AD)u[t)  +  w2(t),  (2.6) 

and  neth-order  dynamic  compensator  (2.3),  (2.4),  the  performance  criterion 

J(Ae,Be,Ce)  =  sup  limsupIE[zT(t)R1i(t)  +  2xT(t)Rliu(t)  +  uT(t)R2u(t)]  (2.7) 

(4A,AB,AC,AD)eU  *-»«> 
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is  minimized. 

Remark  2.1.  The  cost  functional  (2.7)  is  identical  to  the  standard  LQG  criterion  with  the 
exception  of  the  supremum  for  evaluating  worst-case  quadratic  performance  over  U.  Note  that  (2.7) 
can  also  be  written  in  terms  of  an  averaged  integral,  i.e., 

J(Ae,  Be,Ce )  — 

sup  limsup-^IEl  f  frT(s)i?iz(s)  +  2xT(s)f?15u(s)  +  uT(s)i2ju(s)ldal. 

(AA,AB,AC,AD)€U  t—oo  *  W0  j 

For  practical  application,  the  cost  (2.7)  provides  the  means  for  minimizing  the  variances  of  selected 
state  variables  and  control  signals.  This  can  be  achieved  by  appropriate  selection  of  the  matrices 
Ri  and  Rj  which  serve  as  design  weights.  For  robust  performance  the  goal  is  to  minimize  the 
worst-case  variances  of  selected  variables  over  the  plant  uncertainty. 

For  each  uncertain  variation  ( AA,AB,AC,AD )  €  U,  the  undisturbed  closed-loop  system 
(2.1)— (2.4)  can  be  written  as 


x(t)  =  (A  4-  AA)x(t),  t  6  [0,  oo), 


(2.8) 


where 


BCe 

Ae  +  BeDCe  ’ 


AA  = 


AA 

BeAC 


ABCe 

BeADCe 


Similarly,  the  disturbed  closed-loop  system  (2.3)-(2.6)  can  be  written  as 


*(t)  =  (A  +  AA)x{t)  +  u)(t),  t  <=  [0,oo), 


(2.9) 


where  the  closed-loop  disturbance  u5(t)  has  intensity  V  £  IN". 


3.  Sufficient  Conditions  for  Robust  Stability  and  Performance 


In  practice,  steady-state  performance  is  only  of  interest  when  the  undisturbed  closed-loop 
system  (2.8)  is  robustly  stable  over  U.  The  following  result,  which  expresses  the  performance  in 
terms  of  the  steady-state  closed-loop  second-moment  matrix,  is  immediate. 

Lemma  3.1.  Let  ( Ae,Be,Ce )  be  given  and  suppose  the  system  (2.8)  is  stable  for  all  (AA,  AB, 
AC,  AD)  €  U.  Then 

J(Ae,Be,Ce)=  sup  irQ.^R,  (3.1) 

(AA,AB,AC,AD)€U 
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where  Q^x  =  limt_oo  EE[z(t)iT(i)]  €  IN*  is  the  unique  solution  to 

0  =  (A  +  AA)QaA  +Q^(A  +  AA)t  +  V. 

Remark  3.1.  When  U  is  compact,  “sup”  in  (3.1)  can  be  replaced  by  “max” . 


(3.2) 


The  key  step  in  guaranteeing  robust  stability  and  performance  is  to  replace  the  uncertain 
terms  in  the  covariance  Lyapunov  equation  (3.2)  by  a  bounding  function  fi.  Note  that  since  AA  is 
independent  of  Ae,  the  bounding  function  need  only  depend  upon  Bc  and  Ce. 


Theorem  3.1.  Let  fi  :  INn  x  IR"“x4  x  IRmX"*  — »  Sn  be  such  that 

AAQ  +  QAAt  <  fi(Q,  Bc,Cc), 

(AA,  AB,  AC,  AD)  eU,  (Q,Be,Ce)  E  IN*  x  lRn‘x4  x  ntmXn,>, 
and,  for  given  ( Ac,Bc,Ce ),  suppose  there  exists  fi  E  INn  satisfying 

0  =  Afi  +  QAr  +  fi(Q,Bc,Ce)  +  V. 

Then 

(A  +  AA,  \V  +  fi(Q,Be,Ce)  -  (AAQ  +  fiAA1)]^)  is  stabilizable, 
(AA,AB,AC,AD)eU, 

if  and  only  if 

A  +  AA  is  asymptotically  stable,  (AA,  AB,  AC,  AD)  E  U . 

In  this  case, 

<2nx<i2,  (AA,AB,AC,AD)eU, 
where  Q^x  given  by  (3.2),  and 

J(Ae,Bc,Ce)<  tr  QR. 


(3.3) 


(3.4) 

(3.5) 

(3.6) 

(3.7) 

(3.8) 


Proof.  First  note  for  clarity  that  in  (3.3)  fi  denotes  an  arbitrary  element  of  IN"  since  (3.3)  holds 
for  all  fi  €  IN",  while  in  (3.4)  fi  denotes  a  specific  solution  to  (3.4).  Now  for  (AA,  AB,  AC,  AD)  E 
U,  (3.4)  is  equivalent  to 

0  =  (A  +  AA)  fi  +  Q(A  +  AA)r  +  CJ(Q,  Bc,  Ce)  -  (AAQ  +  QAA1)  +  V.  (3.9) 

Hence,  by  assumption,  (3.9)  has  a  solution  fi  €  IN"  for  all  (AA,AB,AC,AD)  E  U  and,  by 
(3.3),  n(Q,Bc,Ce)  -  (AAQ  +  QAAT)  is  nonnegative  definite.  Now  if  the  stabilizability  condition 
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(3.5)  holds  for  all  (AA,  AB,  AC,  AD)  €  U,  it  follows  from  Lemma  12.2  of  [W]  that  A  +  AA  is 
asymptotically  stable  for  all  (AA,AB,AC,AD)  €  U.  Conversely,  if  A  +  A  A  is  asymptotically 
stable  for  all  ( AA,AB,AC,AD )  €  U,  then  (3.5)  holds.  Next,  subtracting  (3.2)  from  (3.9)  yields 

0  =  {A  +  AA)(Q  -  Q n)  +  (Q  -  Q4yi)(A  +  AA)t  +  n(Q,  Be,  Ce)  -  ( AAQ  +  QAA *), 
or,  equivalently,  since  A  +  AA  is  asymptotically  stable  for  all  (AA,  AB,AC,  AD)  €  U, 

Q  ~  Qaa  =  f  «(/i+*ii)t[rt(2,Be,Ce)  -  (AAQ  +  QAA^y^^^dt  >  0, 

Jo 

which  implies  (3.7).  The  performance  bound  (3.8)  is  now  an  immediate  consequence  of  (3.7).  □ 

Remark  3.2.  In  applying  Theorem  3.1  it  may  be  convenient  to  replace  condition  (3.5)  with  a 
stronger  condition  which  is  easier  to  verify  in  practice.  Clearly,  (3.5)  is  satisfied  if  V- +17(2,  Bc,Cc)  — 
(AAQ  +  QAA7)  is  positive  definite  for  all  (AA, AB ,  AC , AD)  €  U.  This  will  be  the  case,  for 
example,  if  either  V  is  positive  definite  or  strict  inequality  holds  in  (3.3).  Also,  it  follows  from 
Theorem  3.6  of  [W]  that  (3.5)  is  implied  by  the  stronger  condition 

(A  +  AA,V$)  is  stabilizable,  (AA,AB,AC,AD)  €  U.  (3.10) 


Remark  3.3.  The  covariance  bound  (3.7)  can  also  be  used  to  analyze  the  effect  of  disturbances 
on  specified  state  variables.  For  example,  if  JSi  €  IR,xn  then  (3.7)  implies 


[£i 


0«xn.  ]  Q4A 


■  E? 
.On.xq , 


<[£l 


0,xn. ] Q 


.On.xq . 


(3.11) 


so  that  the  right  hand  side  of  (3.11)  serves  as  a  bound  on  selected  state  variances.  For  control- 
design  purposes  we  effectively  set  72i  =  EjEi.  Similar  remarks  apply  to  obtaining  bounds  on  the 
variances  of  control  signals. 


4.  The  Auxiliary  Minimization  Problem 


The  key  step  in  our  development  involves  consideration  of  the  performance  bound  (3.8)  in  place 
of  the  actual  worst-case  performance  J(Ae,  Be,Ce).  This  leads  to  the  following  problem. 

Auxiliary  Minimization  Problem.  Determine  ( Q,Ae,Bc,Cc )  which  minimizes 

J(Q,Ac,Bc,Ce)  =  tr  QR  (4.1) 

subject  to  (3.4)  and 

Q  €  IN*.  (4.2) 
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The  relationship  between  the  Auxiliary  Minimization  Problem  and  the  Robust  Stability  and  Per¬ 
formance  Problems  is  straightforward  as  shown  by  the  following  observation. 

Proposition  4.1.  If  (Q,Ae,Bc,Ce)  satisfies  (3.4),  (4.2)  and  the  stabilizability  condition  (3.5) 
holds,  then  A  +  AA  is  asymptotically  stable  for  all  ( AA,AB,AC,AD )  £  U,  and 

J(Ae,Be,Cc)  <  J(Q,Ae,Be,Ce).  (4.3) 

Proof.  Since  (3.4)  has  a  solution  Q  €  IN"  and  the  stabilizability  condition  (3.5)  holds,  the 
hypotheses  of  Theorem  3.1  are  satisfied  so  that  robust  stability  with  robust  performance  bound 
(3.8)  is  guaranteed.  Note  that  (4.3)  is  merely  a  restatement  of  (3.8).  □ 

Several  comments  are  in  order.  Since  the  auxiliary  cost  (4.1)  is  an  upper  bound  for  the  actual 
cost  (2.7),  it  is  clearly  desirable  to  minimize  (4.1)  over  Q  and  the  controller  gains.  Note,  however, 
that  the  Auxiliary  Minimization  Problem  is  a  nonconvex  mathematical  programming  problem  on 
a  noncompact  set.  Hence  guarantees  of  existence  of  solutions  and  sufficient  conditions  for  global 
optimality  cannot  be  obtained  without  imposing  additional  confining  assumptions.  To  develop 
nonrestrictive  results,  we  proceed  in  Section  6  by  deriving  necessary  conditions  for  optimality 
which  require  no  further  assumptions  except  that  Cl  be  differentiable  and  that  the  minimization 
be  performed  over  an  open  set.  In  the  next  section  we  construct  a  bound  Cl  which  possesses  the 
required  smoothness. 

5.  Uncertainty  Structure  and  the  Guaranteed  Cost  Bound 

Having  established  the  theoretical  basis  for  our  approach,  we  now  assign  explicit  structure  to 
the  set  U  and  bounding  function  17.  Specifically,  the  uncertainty  set  U  is  assumed  to  be  of  the  form 

p  p  p 

U  =  {{A A,  AB,  AC, AD)  :  AA=^OiAi,  AB  =  J2a*Bi,  AC  — 

»=i  »=i  »=i 

AL>  =  '%2  ^  !}» 

i=l  1=1 

where,  for  *  =  1, . . .  ,p  :  A*  £  IRnx",  fl,  £  IRnx,n,  C,  €  IR*xn,  and  Z\  £  IR'  <m  are  fixed  matrices 
denoting  the  structure  of  the  parametric  uncertainty;  a*  is  a  given  positive  number;  and  <r,  is  an 
uncertain  real  parameter.  Note  that  the  uncertain  parameters  are  assumed  to  lie  in  a  specified 
ellipsoidal  region  in  IRP.  The  closed-loop  system  (2.8)  thus  has  structured  uncertainty  of  the  form 

p 

AA  =  '5T<riAi,  (5.2) 

1=1 


(5.1) 
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where 


BiCe 

BeDiCe  ' 


i  =  1 


The  uncertainty  set  U  is  general  in  the  sense  that  no  explicit  assumptions  such  as  the  matching 
conditions  used  in  [BCL]  will  be  made  with  regard  to  the  structure  of  Ai,Bi,Ci,  and  D *.  We 
do,  however,  require  (as  is  evident  from  (5.1))  that  the  uncertain  parameters  o’,-  appear  linearly  in 
the  off-nominal  perturbations  which  is  more  confining  than  matching  assumptions.  Note  that  the 
symmetry  of  the  uncertainty  set  entails  no  loss  of  generality  by  requiring  only  a  redefinition  of  the 
nominal  plant  matrices. 

In  order  to  obtain  explicit  gain  expressions  for  ( Ae,Be,Ce )  in  Section  6,  we  shall  require  one 
additional  technical  assumption.  Specifically,  we  assume  that  for  each  i  €  {1, .  at  most 

one  of  the  matrices  Bi,Ci,  and  Di  is  nonzero.  This  condition  thus  implies  that  a  given  uncertain 
parameter  <Ti  may  appear  explicitly  in  both  AA  and  AB,  or  both  AA  and  AC,  or  both  AA  and  AD, 
or  only  AA,  but  not  (say)  in  both  AB  and  AD.  Thus  we  can  account  partially  (but  not  totally)  for 
correlated  parameter  uncertainties  in  different  plant  matrices.  If  a  given  uncertain  parameter  does 
arise  in  both  (say)  AB  and  AD,  then  it  must  be  represented  by  two  distinct  uncertain  parameters. 
If  this  assumption  is  not  imposed,  then  optimality  conditions  can  still  be  derived,  but  at  the  expense 
of  closed-form  gain  expressions. 

For  the  structure  of  U  as  specified  by  (5.1),  the  bound  D  satisfying  (3.3)  can  now  be  given  a 
concrete  for  n. 

Proposition  5.1.  Let  a  be  an  arbitrary  positive  scalar.  Then  the  function 

n(Q,Be,Ce )  =  aQ  +  a~l  (5-3) 

i=i 

satisfies  (3.3)  with  U  given  by  (5.1). 

Proof.  Note  that 

°  -  H  ~  (a</a*)A<]T 

t=  l 

=  +  a-'^ctiAiQAj  +  QAi), 

i- 1  «=1  »=1 

which,  since  /ai  -  implies  (3.3).  □ 
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Remark  5.1.  Note  that  the  bound  (1  given  by  (5.3)  consists  of  two  distinct  terms.  The 
first  term  aQ  can  be  thought  of  as  arising  from  an  exponential  time  weighting  of  the  cost,  or, 
equivalently,  from  a  uniform  right  shift  of  the  open-loop  dynamics  ([AMJ).  The  second  term 
a-1Si=i  ot]AiQ.Aj  arises  naturally  from  a  multiplicative  white  noise  model  ([BG1],[BG2],[B2]). 
Such  interpretations  have  no  bearing  on  the  results  obtained  here  since  only  the  bound  Ci  defined 
by  (5.3)  is  required.  Note  that  the  bound  (5.3)  is  valid  for  all  positive  a.  A  similar  bound  was  also 
considered  in  [KB]. 


With  fi  defined  by  (5.3),  the  modified  Lyapunov  equation  (3.4)  becomes 

p 

0  =  AQ  +  QAr  +  aQ  +  ct-'^alAiQAj  +  V 

i=l 


or,  equivalently, 

p 

0  sss  AaQ  +  <2A^  +  +  V , 

«=i 


where 

Aa  BCe 

BcC  Aea  +  BeDCe 

and  -a  =  o i}/a.  Note  that  (5.5)  is  equivalent  to 


0  =  /tvec  Q  +  vec  V , 


Aa^A+  f/*  = 


(5.4) 


(5.5) 


(5.6) 


(5.7) 


where  “vec”  is  the  column-stacking  operation  defined  in  [B3]  and  A  is  defined  by 

p 

A  =  Aa@Aa  +  '%2'uAi  9  Ai . 

i=l 


Next,  using  the  bound  Cl  given  by  (5.3)  and  U  given  by  (5.1)  we  present  a  result  which  guarantees 
the  existence  of  a  nonnegative-definite  solution  to  (3.4)  or,  equivalently,  (5.5)  for  a  given  controller 
(Ae,  Bc,Ce).  For  the  converse  we  view  V  as  an  arbitrary  element  of  INn. 

Proposition  5.2.  Let  (Ae,  Be,Ce)  be  given  and  let  a  >  0.  If  A  is  asymptotically  stable, 
then  there  exists  a  unique  h  x  n  Q  satisfying  (5.5)  and,  furthermore,  Q  >  0.  Conversely,  if  for  all 
V  <5.  INn  there  exists  Q  >  0  satisfying  (5.5),  then  A  is  asymptotically  stable. 

Proof.  Since  (5.5)  is  equivalent  to 

Q  =  -vec_1[^_1vec  V],  (5.8) 
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existence  and  uniqueness  hold.  To  prove  that  <2  is  nonnegative  definite,  we  rewrite  (5.8)  as 

Q  =  f  vec-l[e,<tvec  V'jdt  (5.9) 

Jo 

and  show  that  the  integrand  is  nonnegative  definite  for  all  t  €  [0,oo).  [Note  that  the  following 
argument  does  not  require  that  A  be  stable.]  Using  the  Lie  exponential  product  formula,  the 


exponential  in 

(5.9)  can  be  written  as 

eAt  =  Jfim  {exp[|(Aa  ©  Aa)t ]  JJ  «xp[^7<(A<  ®  Ai)t] }  . 

tsl 

(5.10) 

For  convenience,  let  S  and  N  be  r  x  r  matrices  with  N  >  0.  Since  (see  [B3]) 

vec-1  [(5  ®  S)vec  JV]  =  SNS  T  >  0 

(5.11) 

and 

(Sk  ®  Sk)(S  ®  5)  =  Sk+1  ®  Sk+1, 

(5.12) 

it  follows  that 

QQ 

Furthermore, 

vec-1[es®5vec  JV]  =  ^(fc!)-15fciVS*T  >  0. 

fc=0 

(5.13) 

vec-1  [e5®5 vec  N]  =  vec-1  [(es  ®  es)vec  N ]  =  esNesT  >  0. 

(5.14) 

Applying  (5.13)  and  (5.14)  alternately  with  (5.10)  and  using  induction  on  k  it  follows  that  the 

integrand  of  (5.9)  is  nonnegative  definite.  To  prove  the  converse,  note  that  it  follows  from  (5.5) 
that  Q  satisfies 

Q  =  vec~i[«-4*vec  Q]  +  f  vec_1[e^*vec  V\da,  t€[0,oo).  (5.15) 

Jo 

Since  the  integral  term  on  the  right  hand  side  of  (5.15)  is  nonnegative  definite,  is  bounded  from 
above  by  £>,  and  V  €  INn  is  arbitrary,  it  follows  that  A  is  asymptotically  stable.  □ 

Proposition  5.2  shows  that  a  solution  to  (5.5)  exists  so  long  as  cti, . . . ,  ap  are  sufficiently  small 
that  A  remains  stable  for  some  a  >  0.  The  following  result  characterizes  values  of  an, . . . ,  ap  for 
which  A  is  asymptotically  stable.  Let  |[  •  j|  denote  an  arbitrary  vector  norm  and  its  induced  matrix 
norm. 

Proposition  5.3.  Let  (Ae,Be,Ce)  be  given,  assume  A  is  asymptotically  stable,  and  let 
a,al,...,op  >  0.  If 

p 

||(A®  A)~l(a/ft,  +£7^®A<)||  <  1,  (5-16) 

•  si 
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then  there  exists  Q  €  IN'*  satisfying  (5.5)  and  A  is  asymptotically  stable. 

Proof.  Define  {5fc}£L0  where  fio  satisfies 

0  =  AQ0  +  Q0Ar  +  V, 

and  <2*+i  satisfies 

0  =  AQk+i  +  Qk+iAr  +  n(Qk,  Be,Ce)  +  V . 

Note  that  Qk>  0,  A;  =  1,2,....  Hence  it  follows  that 

vec  2k+i-vec  Qk  =  -(A©  A)-1[vec  fl(2*,  Be,Ce)  -  vec  fl(2fc_i,  Bc,Ce)] 


and  thus 

p 

||vec  Qk+  i-vec  fifc||  <  ||(A©  A)-1(o(/aj  +  ®  i«||||vec  Qk  -  vec 

«=i 

Using  (5.16)  it  follows  that  Q  =  limjt_00  Qk  exists.  Thus  Q  >  0  and  satisfies  (5.5).  Furthermore, 
since  V  €  IN'*  can  be  considered  arbitrary,  Proposition  5.2  implies  that  A  is  asymptotically  stable. 
□ 

6.  Necessary  Conditions  for  the  Auxiliary  Minimization  Problem 

The  derivation  of  the  necessary  conditions  for  the  Auxiliary  Minimization  Problem  is  based 
upon  the  Fritz  John  form  of  the  Lagrange  multiplier  theorem.  Rigorous  application  of  this  theorem 
requires  that  we  further  restrict  (Q,  Ae,  Be,  Ce)  to  the  open  set 

S  =  {(<2,Ae,Be,Ce)  :  Q  e  IP",  A  is  asymptotically  stable, 
and  (Ae,  Be,Ce)  is  controllable  and  observable}. 

As  will  be  seen,  the  constraint  ( Q ,  Ae,  B„,  Ce)  €  S  is  not  required  for  either  robust  stability  or  robust 
performance  since  Proposition  4.1  shows  that  only  (3.4),  (3.5)  and  (4.2)  are  needed.  Rather,  the 
set  S  constitutes  sufficient  conditions  under  which  the  Lagrange  multiplier  technique  is  applicable 
to  the  Auxiliary  Minimization  Problem.  Specifically,  the  condition  Q  >  0  replaces  (4.2)  by  an 
open  set  constraint,  the  asymptotic  stability  of  A  serves  as  a  normality  condition  which  further 
implies  that  the  dual  P  of  Q  is  nonnegative  definite,  and  (Ac,Be,Ce)  minimal  is  a  nondegeneracy 
condition  which  implies  that  the  lower  right  ne  x  ne  subblocks  of  Q  and  P  are  positive  definite  thus 
yielding  explicit  expressions  for  Be  and  Ce.  Note  that  by  Proposition  5.2  the  condition  that  A  be 
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asymptotically  stable  also  implies  that  (5.5)  has  a  unique,  nonnegative  solution.  Finally,  we  point 
out  that  the  stabilizability  condition  (3.5)  and  stability  condition  (3.6)  play  no  role  in  determining 
solutions  of  the  Auxiliary  Minimization  Problem. 

In  order  to  state  the  main  results  we  require  some  additional  notation  and  a  lemma  concerning 
pairs  of  nonnegative-definite  matrices.  For  a  real  n  x  n  matrix  Z  define  the  set  of  real  diagonalizing 
matrices 

P(Z)  =  {9eJRnXn  :  f-'Z*  is  diagonal}, 

and,  for  a  pair  of  n  x  n  symmetric  matrices  X,  Y  define  the  set  of  real  contragrediently  diagonalizing 
matrices 

C(X,Y )  4  {9  €  P(XY)  :  and  JPTK!P  are  diagonal} 

and  the  subset  of  real  balancing  transformations 

B{X,Y)  =  {fe  C(X,Y)  :  9-lX9-v  =  l ?TYf}. 

Of  course,  a  necessary  condition  for  B{X,Y)  to  be  nonempty  is  that  X,Y,  and  XY  all  have  the 
same  rank.  Note  that  in  general 


B{X,Y)  c  C{X,Y)  c  P{XY).  (6.1) 

Obviously,  a  diagonalizable  matrix  is  either  invertible  (has  no  zero  eigenvalues)  or  has  semisimple 
zero  eigenvalues.  Hence  if  P(Z)  Q)  then  the  group  generalized  inverse  Z*  exists  as  a  special  case 
of  the  Drazin  generalized  inverse  ([CM]).  Note  that  we  limit  our  consideration  to  diagonalizable 
matrices  with  real  eigenvalues.  Also,  note  that  there  is  no  assumption  here  that  Z  is  symmetric.  Of 
course,  when  Z  is  symmetric  the  group,  Drazin,  and  Moore-Penrose  generalized  inverses  coincide. 

Lemma  6.1.  Let  Q,P  €  INn  and  let  r  =  rank  QP.  Then  the  following  statements  hold: 

(i)  QP  has  nonnegative  eigenvalues. 

(ii)  C(Q,P)*(Z>. 

(iii)  QP  is  diagonalizable. 

(iv)  The  n  x  n  matrix 

r  4  QP{QP)*  =  ( QP)*QP  (6.2) 
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is  idempotent,  i.e.,  r  is  an  oblique  projection,  and 


rank  r  =  r. 


(6.3) 


(v)  There  exists  G,  T  €  IRrXn  and  invertible  M  €  IRrXr  such  that 

(6.4) 

(6.5) 

(vi)  If  G,  r  €  IRrXn  and  M  €  IRrxr  satisfy  (6.4)  and  (6.5),  then 


QP  =  GTMr, 
rGT=Ir. 


7  =  rank  T  =  rank  M  =  r, 

(6.6) 

(QP)*  =  GrM~lr, 

(6.7) 

t  =  Grr , 

(6.8) 

rGr  =  G\  fr  =  P 

(6.9) 

(vii)  The  matrices  G,T  €  IRrX,‘  and  M  €  IRrXr  satisfying  (6.4)  and  (6.5)  are  unique  except 
for  a  change  of  basis  in  IRr.  Furthermore,  all  such  M  are  diagonalizable  with  positive 
eigenvalues. 

(viii)  If  rank  Q  =  rank  P  =  r  then  B(Q,P)  ^  Q)  and 


Q  =  rQ  =  <5rT  =  rQrT, 

(6.10) 

P  =  rTP  =  Pr  =  rTPr. 

(6.11) 

Proof.  See  Appendix  A.  □ 

A  triple  ( G,M,r )  satisfying  (6.4)  and  (6.5)  with  G,T  G  IRrXn,  Me  IRrxr,  and  r  =  rank  QP 
will  be  called  a  projective  factorization  of  QP.  In  particular,  we  shall  set  r  =  ne.  Furthermore, 
define  the  complementary  projection 

r±  =  In  ~  r,  (6.12) 
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and,  for  arbitrary  Q,P,Q,P  €  IRnXn,  G,T  €  IRn“Xn,  Be  €  IRn*x4,Ce  €  IRmxn*,  and  a  >  0, 
define  the  following  notation: 


Va.  =  V,  +  £  7.-  +  Q)C?  +  DiCerQrrclDj) , 

»=i 

Ru  =  R*  +  Y1  V  iBi(P  +  P)Bi  +  D?BjGPGTBcDi] , 

»=1 

Q.  4  QCT  +  Vt J  +  2  7<  [*  (Q  +  Q)C 7  +  AiQrrCjD?\ , 

i=l 

P.  =  BTP  +  R?3  +  1*  [B?(p  +  -  DJB?GPAi\ , 

»=i 

Aq  =  Aa-  Q.V,-lC ,  AP  4  Aa  -  BR^fP,. 

The  above  definitions  are  for  convenience  in  stating  the  necessary  conditions  for  the  Auxiliary 
Minimization  Problem.  This  result  provides  explicit  formulae  for  extremals  (Q,Ac,Bc,Cc)  of  the 
Auxiliary  Minimization  Problem.  A  partial  converse  shows  that  this  form  of  the  necessary  condi¬ 
tions  represents  no  loss  of  generality  with  regard  to  the  constraint  equation  (5.5). 


Theorem  6.1.  (I)  Suppose  ( Q,Ae,Be,Ce )  €  S  solves  the  Auxiliary  Minimization  Problem 
with  U  given  by  (5.1)  and  Cl  given  by  (5.3).  Then  there  exist  Q,P,Q,P  €  lNn  such  that,  for  some 
projective  factorization  ( G,M,T )  of  QP,  ( Q,Ae,Be,Ce )  are  given  by 

\q  +  q  grT ' 

rg  rgrTJ  ’ 

Aa  =  r(A  -  BR2.lP.  -  Q.VfSC  +  Q.V2-,1DRt.1P.)GT, 

Be  =  rQ.Vf.\ 

Ca  =  -RulP.G\ 


Q  = 


and  such  that  Q,P,Q ,  and  P  satisfy 

p 


0  =  AaQ  +  QAl  +  Vi  +  7< [AiQAj  +  (*  -  BiR2*  P,)Q(Ai  -  BiR2,1P.)T] 


t=i 

r-lnT. 


“  Q»VuQ.  +  rxQ.VfSQjrl, 

p 

o  =  AlP  +  PAa  +  Ri  +  i[AjpAi  +  [Ai  -  Q.Vf.'CifPiAi  -  g.V^C,)] 

i=l 

-  PjR2.lP.  +  rlPjRi.lP.r±, 

0  =  Af»Q  +  QAl  +  Q.VfSQj  -  rj.Q.VfSQ  JrJ, 

0  =  AgP  +  PAq  +  PjRrfP.  -  rlPjR2}P.  rj., 
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(6.13) 

(6.14) 

(6.15) 

(6.16) 


(6.17) 

(6.18) 

(6.19) 

(6.20) 


rank  Q  =  rank  P  =  rank  QP  =  nc. 


(6.21) 


Furthermore,  the  auxiliary  cost  is  given  by 

J(Q,  Ae,  Be,  Cc)  =  tr[(g  +  Q)Ri  -  2R13R^P.Q  +  PjR^R3R^,lPfQ] .  (6.22) 

(II)  Conversely,  if  there  exist  Q,P,Q,P  E  IN"  satisfying  (6.17)-(6.21)  with  Be  and  Ce  given 
by  (6.15)  and  (6.16),  then  (2, Ae,Be,Ce)  given  by  (6.13)-(6.16)  satisfy  (4.2)  and  (5.5)  with 
J(Q,Ae,  Be,Ce)  given  by  (6.22). 

Proof.  See  Appendix  B.  □ 

Remark  6.1.  Theorem  6.1  presents  necessary  conditions  for  the  Auxiliary  Minimization  Prob¬ 
lem  which  explicitly  characterize  extremal  quadruples  (Q,Ae,Be,Ce).  These  necessary  conditions 
consist  of  a  system  of  two  modified  Riccati  equations  and  two  modified  Lyapunov  equations  coupled 
by  both  the  optimal  projection  r  and  uncertainty  bounds.  If  the  uncertainty  bounds  are  deleted, 
then  the  results  of  [HB]  are  recovered. 

Remark  6.2.  When  solving  (6.17)-(6.21)  numerically,  the  uncertainty  termr  can  be  adjusted 
to  examine  tradeoffs  between  performance  and  robustness.  Specifically,  the  bounds  and  the 
structure  matrices  A BitCi,  and  Z?,-  appearing  in  V2,,  Rit,  Q„  and  P,  can  be  varied  systematically 
to  determine  the  region  of  solvability  of  (6.17)-(6.21). 

Remark  6.3.  Although  equations  (6.17)-(6.2l)  appear  formidable,  they  are,  in  fact,  quite  nu¬ 
merically  tractable.  For  related  problems  involving  coupled  Riccati  equations,  homotopic  corfinu- 
ation  methods  have  been  shown  to  be  effective  ([KLJ],[MB]).  Similar  algorithms  for  solving  (6.17)- 
(6.21)  have  been  developed  in  [GH],[R],  while  iterative  algorithms  are  discussed  in  [G2j,[GV],[CY]. 

Remark  6.4.  Because  of  the  presence  of  Be  and  Ce  in  the  definitions  of  Vj,,  Ri,,Q,,  and 
P„  the  optimality  conditions  (6.17)-(6.20)  are  coupled  with  the  gain  expressions  (6.15)  and  (6.16) 
for  Be  and  Cc.  When  the  problem  is  specialized  to  the  case  =  0,  *  =  1,  ...,p,  this  coupling 
disappears  and  equations  (6.17)-(6.20)  can  be  solved  without  reference  to  the  gain  expressions 
(6.15)  and  (6.16). 

7.  Sufficient  Conditions  for  Robust  Stability  and  Performance 

In  this  section  we  combine  Theorem  3.1  with  Theorem  6.1  (II)  to  obtain  our  main  result 
guaranteeing  robust  stability  and  performance. 
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Theorem  7.1.  Suppose  there  exist  Q,P,Q,P  €  IN"  satisfying  (6.17)-(6.21)  with  Bc  and 
Ce  given  by  (6.15)  and  (6.16).  Then,  with  (Q,Ae,Be,Ce)  given  by  (6.13)-(6.16),  (A  +  AA,  [V  + 
f2{Q,Be,Ce)  -  (AAQ.  4-  fiAA1)]^)  is  stabilizable  for  all  ( AA,AB,AC,AD )  €  U  if  and  only  if 
A  +  AA  is  asymptotically  stable  for  all  ( AA,AB,AC,AD )  €  U.  In  this  case,  the  performance 
(2.7)  of  the  closed-loop  system  (2.9)  satisfies  the  bound 

J(Ae,Be>Ce)  <  tr [(Q  +  Q)RX  -  2 RuRu'P.Q  +  PjR^R^P.Q}.  (7.1) 

Proof.  The  converse  portion  of  Theorem  6.1  implies  that  Q  given  by  (6.13)  is  nonnegative  defi¬ 
nite  and  satisfies  (5.5)  or,  equivalently,  (3.4).  It  now  follows  from  Theorem  3.1  that  the  stabilizabil- 
ity  condition  (3.5)  is  equivalent  to  the  asymptotic  stability  of  A+AA  for  all  (AA,  AB,  AC,  AD)  €  U. 
In  this  case  Proposition  4.1  yields  robust  stability  and  performance.  The  robust  performance  bound 
(7.1)  is  a  restatement  of  (4.3)  utilizing  (6.22).  □ 

Note  that  Theorem  7.1  is  constructive  in  nature  rather  than  existential.  Specifically,  Theorem 
7.1  involves  a  coupled  system  of  modified  Riccati /Lyapunov  equations  (6.17)-(6.21)  whose  solutions, 
when  they  exist,  are  used  to  explicitly  construct  the  dynamic  feedback  gains  (6.14)-(6.16)  which 
are  guaranteed  to  provide  both  robust  stability  and  performance.  The  following  existence  result 
concerns  the  solvability  of  (6.17)-(6.2l).  Let  nu  denote  the  dimension  of  the  unstable  subspace  of 
the  plant  dynamics  matrix  A. 

Theorem  7.2.  Assume  ne  >  n„,  Ri  >  0,  V\  >  0,  suppose  the  nominal  plant,  i.e.,  (2.1),  (2.2) 
with  a,-  =  0,  »  =  1, . . .  ,p,  is  stabilizable  and  detectable  and,  in  addition,  is  stabilizable  by  means 
of  an  neth-order  strictly  proper  dynamic  compensator  (2.3), (2.4).  Then  there  exist  ax,..  .,5P  >  0 
such  that  if  cn  €  [0,  a*),  *  =  1, . . .  ,p,  then  (6.17)-(6.2l)  have  a  solution  Q,P,Q,Pe  IN"  for  which 
(Ac,Be,Ce)  given  by  (6.14)-(6.16)  solves  the  Robust  Stability  Problem  with  robust  performance 
bound  (6.22V 

Proof.  From  Theorem  3.1  of  [Rl],[R2]  it  follows  that  there  exists  a  solution  to  (6.17)-(6.21) 
which  stabilizes  the  nominal  plant.  By  continuity  there  exists  a  neighborhood  over  which  robust 
stability  with  performance  bound  (6.22)  holds.  □ 

Theorem  7.2  is  an  existence  result  which  guarantees  solvability  of  the  sufficiency  conditions 
over  a  range  of  parameter  uncertainties.  The  actual  range  of  uncertainty  which  can  be  bounded 
and  the  conservatism  of  the  performance  bound  are,  of  course,  problem  dependent. 
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8.  Specialization  to  Full-Order  Dynamic  Compensation 

To  draw  connections  with  standard  full-order  LQG  theory,  we  specialize  the  results  of  Sections 
6  and  7  to  the  full-order  case,  i.e.,  ne  =  n.  As  discussed  in  [HB],  in  the  full-order  case  G  =  r~1 
and  thus  G  —  T  =  r  =  In  and  rj.  =  0  without  loss  of  generality.  To  develop  further  connections 
with  standard  LQG  theory  assume 

R12  —  0,  Vij  =0,  D  =  AD  —  0.  (8-1) 

Since  AD  =  0  we  shall  write  (AA,AB,AC)  in  place  of  ( AA,AB,AC,AD ).  Also,  for  arbitrary 
Q,P,Q,P  €  IRnxn  and  a  >  0  define  the  following  notation: 

Vl  =  V,  +  £  7  iCi{Q  +  Q)Cj ,  Ru  =  7 iB?(P  +  P)Bi> 

«=i  »=i 

Q.  =  QCr+^2  7 iMQ  +  Q)C ?,  p.  =  BrP  +  J2  7  iBj{P  +  P)Ai, 

«= 1  »=1 

AQ±Aa-  Q.Vf.'C,  Ap  =  Aa-  BR^P.. 

Theorem  8.1.  Let  ne  =  n,  assume  (8.1)  is  satisfied,  and  suppose  there  exist  Q,P,Q,P  6  INn 
satisfying 

p 

0  =  AaQ  +  QAl  +  V1  +  Y,'U  [AQA?  +  (A<  -  /fc,-xP.)Q(A<  -  BiRf.'P.)1]  -  Q.VftlQj,  (8.2) 

»'=i 

0  =  A*P  +  PAa  +  *!+£>.  [AjPAi  +  (Ai-  QtVf'1Ci)TP(Ai  -  Q.V£XC<)]  ~  PJK'P;  (8.3) 

«=i 


0  ^ApQ  +  QAl+Q.VfSQj, 

(8.4) 

0  =  AqP  +  Paq  +  PJr2,P„ 

(8.5) 

and  let  (Q,Ae,Be,Cc)  be  given  by 

2=f«t<’  <?1, 

Q  Q  ’ 

(8.6) 

Ae  ~  A  -  BR^P.  -  Q.Vf.'C , 

(8.7) 

Se  = 

(8.8) 

Cc  =  -K1p- 

(8.9) 

Then,  (A  + AA,  [V-  +  fJ(Q,Be,Ce )  -  (^Afi  -I-  fl^A1)]*)  is  stabilizable  for  all  ( AA,AB,AC )  e  &  if 
and  only  if  A  +  AA  is  asymptotically  stable  for  all  (AA,  AB,  AC)  €  U.  In  this  case  the  performance 
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of  the  closed-loop  system  (2.9)  satisfies  the  bound 

J(Aet  Be,Ce)  <  tr[(g  +Q)Ri  +  PJkgRtk£PmQ] .  (8.10) 

Proof.  The  proof  follows  from  the  reduced-order  case  given  in  Appendix  B.  □ 

Remark  8.1.  Theorem  8.1  presents  sufficient  conditions  for  robust  stability  and  performance 
for  full-order  dynamic  compensation.  These  sufficient  conditions  comprise  a  system  of  two  modified 
Riccati  equations  and  two  Lyapunov  equations  coupled  by  the  uncertainty  bounds.  This  coupling 
illustrates  the  breakdown  of  regulator /estimator  separation  and  shows  that  the  certainty  equival¬ 
ence  principle  is  no  longer  valid  for  the  LQG  result  with  real-valued  structured  plant  parameter 
variations.  If,  however,  the  uncertainty  terms  A,-,  ,  C,  are  set  to  zero,  it  can  be  seen  that  (8.4) 

and  (8.5)  drop  out,  while  (8.2)  and  (8.3)  reduce  to  the  standard  separated  Riccati  equations  of 
LQG  theory. 

9.  Illustrative  Numerical  Example 

To  demonstrate  the  above  results  we  present  an  illustrative  numerical  example.  The  example 
chosen  was  originally  used  in  [D]  to  illustrate  the  lack  of  a  guaranteed  gain  margin  for  LQG 
controllers.  This  example  was  also  considered  in  [BGl]  for  a  preliminary  robustness  study.  Define 

n  =  2,  m  =  1  =  p=  1, 

A=  0  1  ’  B=  1  ’  c  =  [l  °I»  D  =  0> 

Ai=  °  °  ,  Bi=  J  ,  Ci  —  [0  0],  Di  =  0, 

*=Vi=[!£  2]’  ^=^=i- 

Note  that  the  system  is  open-loop  unstable  and  becomes  unstabilizable  at  <Ti  =  —  1.  As  can  easily 
be  seen  using  root  locus,  a  strictly  proper  stabilizing  controller  must  be  of  at  least  second  order. 
Hence  we  consider  (6.17)-(6.21)  with  ne  =  n  and  thus  t±  =  0.  Using  algorithms  described  in 
[GH],[R],  controllers  were  obtained  for  (a,  aj)  =  (.l,.l),  (.4, .2)  and  (1.6, .4).  Figure  1  compares 
the  guaranteed  robust  stability  region  to  the  actual  robust  stability  region.  Note  that  the  design 
approach  yields  greater  stability  than  is  guaranteed  a  priori.  This  phenomenon  is  not  surprising 
since  even  the  LQG  result  may  provide  arbitrarily  high  levels  of  robustness  for  particular  problems 
while  failing  to  guarantee  even  minimal  robustness  for  all  problems.  These  results  thus  demonstrate 


the  ability  of  the  theory  to  robustify  the  LQG  result.  Interestingly,  the  form  of  the  actual  stability 
region  mimics  the  classical  6  dB  downward/infinite  dB  upward  gain  margin  of  full-state-feedback 
LQR  controllers.  Finally,  Figure  2  compares  guaranteed  closed-loop  performance  to  actual  closed- 
loop  performance  over  the  guaranteed  closed-loop  robust  stability  region.  Controller  gains  are  given 
in  Table  1. 
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PERFORMANCE 


Figure  2 
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APPENDIX  A:  Proof  of  Umzru  8.1 


(0 


Clearly  Qp  and  P^QP^  have  the  tame  nonsero  eigenvalues.  Since  P^QP^  is  aonnegative 
definite,  QP  haa  nonnegative  eigenvalues. 


(ii)  The  result  follows  from  Theorem  6.2.5  of  (RM],  p.  123.  See  also  Theorem  4.3  of  [Glj. 

(iii)  This  result  follows  from  (ii)  and  (6.1). 

(iv)  This  result  follows  from  the  definition  of  the  group  generalised  inverse  (see  [CM]).  Alternatively, 

let  QP  =  where  #  €  D[QP),  D  =  diag(dj . d»).  Then  [QP)*  =  #£>*#-*,  where 

Dj0  =  1/*  if  *  *  0,  and  =  0,  if  4  a  0,  *  =  1,. . . ,».  Hence  QP[QP)*  =  #£#-»  is 
idempotent,  where  £  is  a  diagonal  matrix  with  r  ones  and  n  -  r  seroe  on  the  diagonal.  Clearly, 
(6.3)  is  valid. 


(v)  Without  loss  of  generality  choose  9  in  the  preceding  argument  so  that  D  —  block-diag(£>,On.r), 
where  £>  =  diag( ii . <£■),<&  >0,  »  =  l,...,r.  Hence 


Qp  —  #[  ^  0rx(»-f 

V^-ri0(w_r)xr  0n_r 


and  thus  (6.5)  holds  with 


c  =  [/r  orx(n.r)i!fT,  m=£>,  r  =  [/r  orx(n.r)|i?-1. 


(vi)  Sylvester’s  inequality  and  (6.4)  imply  that 

r  =  rank  QP  <  {rank  G,  rank  Af,  rank  f}  <  r, 

which  yields  (6.6).  The  expression  (6.7)  for  [QP)*  follows  directly  form  the  definition  of  the 
group  generalised  inverse.  Furthermore,  (6.2),  (6.5)  and  (6.7)  imply  (6.8),  while  (6.5)  and  (6.8) 
imply  (6.9). 

(vii)  Let  both  ( G,M,T )  and  an  identically  dimensioned  triple  [G,  M,  t)  satisfy  (6.4).  Then  it  is 
easy  to  verify  that  G  =  S~1G,  M  =  SMS~l  and  t  =  ST,  where  S  =  f'GT  and  S~l  =  fGT. 

(viii)  It  follows  from  (ii)  that  there  exists  ! P  €  C[Q,P)  such  that 


*0 

Orx(n-r) 

#’T,  P  =  9~t 

Orx(n-r) 

,0(n— r)xr 

0  n-r 

*  1  4  * 

,°(n-r )xr 

On— r 
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where  Dq  and  Dp  are  positive  diagonal.  Define 

A  —  0f*(i»_r) 

[  0(»-r)xr  An— r 

so  that 

#-*Q#-T=  =  1^4^)*  °' 

and  thus  #  €  8{Q,P).  Finally,  (6.10)  and  (6.11)  are  immediate.  □ 
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O  K 


APPENDIX  B:  Proof  of  Theorem  6.1 


Tb  optimize  (4.10)  over  the  open  set  5  subject  to  the  contraint  (5.5),  form  the  Lagrangian 

f 

C(Q,A»,  Bc,C,,P,X)  =  tr{XQA  +  lAaQ+QAZ+£'riAiQA?+VlP},  (B.l) 

•at 

where  the  Lagrange  multipliers  A  >  0  and  P  €  IR*  *  *  are  not  both  zero.  We  thus  obtain 

f|  =  AlP  +  PA.  +  £  J.AjPA.  +  A*.  (B.2) 

ism  1 

Setting  dC/dQ  =  0  yields 

r  _ 

0  =  A%P  PAg  4-  '^'ijAjPAj  +  A R  (B.3) 

ta| 

or,  equivalently, 

y(Tvec  P  —  -Avec  R. 

Since  A  is  assumed  to  be  stable,  Ar  is  invertible,  and  thus  A  =  0  implies  P  =  0.  Hence,  it  can  be 
assumed  without  loss  of  generality  that  A  =  1.  Furthermore,  it  follows  from  Proposition  5.2  with 
A,V  replaced  by  AT,R  that  P  is  nonnegative  definite. 


Now  partition  n  x  n  Q,  P  into  nxn,  n  x  n„,  and  n„  x  n,  subblocks  as 


Q  i 

Qn 

D  _ 

[ 

a* 

LQia 

Q*. 

»  A  — 

kTz 

Fz  . 

and  define  the  positive-definite  matrices 


Vj.  =  V*  +  J2  li[CiQiC?  +  DiCcQjCjDj],  Ru  =  R,  +  ^  li[BjPiBi  +  DjBjP3BcD,}. 

»=  1  ir  1 

Thus,  the  stationarity  conditions  for  Ae,  Bc,Ce  are  given  by 


j~  =  P^Qit  +  PiQi  =  o, 


(B.4) 


=  PiBeVi,  +  (P'Qx  +  P3Qj3)CT 

+  P?i  [Viz  +  J2  TiiAiQiC?  +  AiQuCjDj)}  =  0, 

tsl 

~£-  =  RuCcQ 2  +  Br(PtQ13  +  P13Q3 ) 


+  [Rit  +  y^,7i(BjP\Aj  +  DjBjP?3Ai)\Qi2  —  0. 

is] 


(B.5) 


(B.6) 
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Expanding  (S.S)  and  (B.3)  yields 


0  =  A^Q1  +  QtAl  +  BC,Qit  +  QiaC?Br 

p 

+  ]£  +  B.C.QJiAJ  +  AiQuCjB?  +  B%CcQ3CJbJ]  +  Vu 

tal 

o  =  A^Qu  +  QiaAja  +  QiiCjDrB?  +  Q,CrBj  +  BCeQa 
+  +  A.QltCjDjBj}  +  ViaBj, 

i>l 

o  =  A.aQt  +  g,A*  +  B.CQx,  +  Q?aCrB?  +  BtDCtQa 
+  QiCjDTBj  +  B'Vt.Bj, 

0  =  AjPj  +  PiAa  +  CTBjP?3  +  PiaBeC 

+  £7.1^1*  +  CW>^  +  AjPuB'Ci  +  C?B?PaBtCi)  Hr  Rlt 

tal 

o  =  AjPi,  +  Px,A«a  +  PiiBeDCe  +  PtBC .  +  CrBjPa 

p 

+  Y,1^P'B'C°  +  AtTPuP«B,Ce]  +  BxlCc, 

tal 

o  =  A*P,  +  PlAaai  +  CjBrPn  +  pTflC.  +  CjR3.Ca. 


(B.7) 

(B.8) 

(B.9) 

(B.10) 

(B.ll) 

(B-12) 


Lemma  B.l.  Qa  and  Pj  are  positive  definite. 

Proof.  By  a  minor  extension  of  results  from  [A],  (B.9)  can  be  rewritten  as 

0  =  (Asa  +  BeDCe  +  BcCQlaQ+)Qa  +  g,(Ae„  +  BeDCt  +  BeCQlaQt)T  +  BeVltBj, 

where  Qf  is  the  Moore- Penrose  or  Drazin  generalized  inverse  of  ga.  Next  note  that  since  (Aca,Bc) 
is  controllable  then,  by  Theorem  3.6  of  [W],  {Aca+BeDCe+B'CQitQt  ,Bev£)  is  also  controllable. 
Now,  since  Qa  and  BeVitBj  are  nonnegative  definite,  it  follows  from  Lemma  12.2  of  [W],  that  Qj 
is  positive  definite.  Using  (B.12),  similar  arguments  show  that  Pj  is  positive  definite.  □ 

Since  R3,,VattQa,  and  Pj  are  invertible,  (B.4)-(B.6)  can  be  written  as 

-Pf'PZQliQI1  =  In„  (B.13) 

Be  =  -Pf'liPfiQi  +  PtQu)CT  +  P*  [Via  +  £ 1'MiC?  +  AiQl3CjDT)]  (B.14) 

i—l 

Ce  =  -Ru{BT(PiQia  +  PiaQa)  +  [R?2  +j2*(B?PlAi  +  DJbJP^)}Q12}q3\  (B.15) 

tsl 
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,  Now  define  the  n  x  n  matrices 

Q  =  Qi  -  QuQ^QT*,  P  =  Pi-  PuPflP?t, 

$  =  QuQi'QTt,  P  =  PuPf'PZ, 

r^-QnQ^P^Pit, 

and  the  ne  x  n,  ne  x  ne,  and  ne  x  n  matrices 

g  =  q21qJ2,  m±q2p2,  r4-pa-»p*. 


Note  that  r  =  GTT. 


Clearly,  Q,  P,Q,  and  P  are  symmetric  and  <$  and  P  are  nonnegative  definite.  To  show  that  Q 
and  P  are  also  nonnegative  definite,  note  that  g  is  the  upper  left-  hand  block  of  the  nonnegative- 
definite  matrix  QQQT,  where 

Q  = 


in  -g»g; 


Jn,xn 


Similarly,  P  is  nonnegative  definite. 


Next  note  that  with  the  above  definitions,  (B.13)  is  equivalent  to  (6.5)  and  that  (6.4)  holds. 
Hence  r  =  GrT  is  idempotent,  i.e.,  r*  =  r.  Furthermore,  it  is  helpful  to  note  the  identities 


=  GrQ2G, 

P  =  -pl2r  =  -rrp?a  =  rrp3r, 

(B.16) 

rGr  =  Gt, 

A  A 

rr  =  r, 

(B.17) 

g  =  rg, 

P  =  Pr, 

(B.18) 

QP  = 

-g»^u- 

(B.19) 

Using  (B.13)  and  Sylvester’s  inequality,  it  follows  that 

rank  G  =  rank  f  =  rank  Qn  =  rank  P12  =  nc. 

Now  using  (B.16)  and  Sylvester’s  inequality  yields 

ne  =  rank  Q22  +  rank  G  -  ne  <  rank  Q  <  rank  Q12  =  nc, 
which  implies  that  rank  g  =  ne.  Similarly,  rank  P  =  ne,  and  rank  QP  =  ne  follows  from  (B.19). 
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The  components  of  Q  end  P  can  be  written  in  terms  of  Q, PtQ,P,G,  and  r  as 


Qx  =  Q  +  Q, 

Pi  =  P+P, 

(B.20) 

Qii  =  QrT, 

Pi  2  =  -PGT, 

(B.21) 

o 

w 

ii 

Pi  =  GPGt. 

(B.22) 

The  expressions  (6.13),  (6.15),  and  (6.16)  follow  from  the  definition  of  2,  (B.14)  and  (B.15). 
Substituting  (B.20)-(B.22)  into  (B.7)-(B.12)  yields 

0  =  AaQ  +  QAl  +  Vk  +  -  BiR^P.)Q{Ai  -  BiR^lP.)T] 

»=i 

+  ApQ  +  QAp,  (B.23) 

0  =  [ApQ  +  Q(GrAear  +  Q.Vf.'Cf  +  Q.V^Qj]  PT,  (B.24) 

0  =  r[{GTAear  +  Q.Vf'lC)Q  +  Q{GrAear  +  Q.V3-1C)r+Q.Va-.1QT]rT,  (B.25) 

0  =  AlP  +  PAa  +  Rl  +  J2'1i  +  (*  -  Q.Vf.lCi)TP{Ai  -  Q.VifCi)] 

i—i 

+  (B.26) 

0  =  [A%P  +  P(GTAear  +  BRZfP.)  +  PjRZ}P.]Gr,  (B.27) 

0  =  G  [(GTAeoP  +  BR^P.)tP  +  P{GTAear  +  BR;.lP.)  +  PjRi.lP.}  Gt.  (B.28) 

Next,  computing  either  /’(B.24)  —  (B.25)  or  G(B.27)  —  (B.28)  yields  (6.14).  Substituting  this 
expression  for  Ac  into  (B.23),  (B.24),  (B.27)  and  (B.28)  it  follows  that  (B.25)  =  P(B.24)  and 
(B.28)  =  G(B.27).  Thus,  (B.25)  and  (B.28)  are  superfluous  and  can  be  omitted.  Next,  using 
(B.23)  +  GTP(B.24)G  -  (B.24)G  -  [(B.24)G]T  and  GTr(B.24)G  -  (B.24)G  -  [(B.24)G]T  yields 
(6.17)  and  (6.19).  Using  (B.26)  +  rTG(B.27)r-(B.27)r-[(B.27)r]Tand  rTG(B.27)r-(B.27)r~ 
[(B.27)P]T  yields  (6.18)  and  (6.20). 

Finally,  to  prove  the  converse  we  use  (6.13)-(6.21)  to  obtain  (5.5)  and  (B.3)-(B.6).  Let 
Ac,Be,Ce,G,r,r,Q,P,Q,P,  Q  be  as  in  the  statement  of  Theorem  6.1  and  define  Qi,<3ia,<?a,Pi, 
P« ,Pj  by  (B.20)-(B.22).  Using  (6.5),  (6.15)  and  (6.16),  it  is  easy  to  verify  (B.5),  (B.6).  Finally, 
substitute  the  definitions  of  Q,P,Q,P,G,  and  r  into  (6.17)-(6.20),  reverse  the  steps  taken  earlier 
in  the  proof,  and  use  (6.13)-(6.16)  along  with  (6.5)  and  (6.8)-  (6.11)  to  obtain  (5.5)  and  (B.3). 
Finally,  note  that 

2= L°x„  rTi- 

which  shows  that  Q  >  0  thus  verifying  (4.2).  □ 
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Unified  optimal  projection  equations  for  simultaneous  reduced-order, 
robust  modelling,  estimation  and  control 

WASSIM  M.  HADDADt  and  DENNIS  S.  BERNSTEINJ 

An  optimal  design  problem  which  unifies  reduced-order  modelling,  estimation  and 
control  problems  is  stated.  Necessary  conditions  for  optimality  are  obtained  in  the 
form  of  a  coupled  system  of  modified  Riccati  and  Lyapunov  equations.  The  results 
permit  treatment  of  several  new  problems,  such  as  reduced-order  dynamic  compen¬ 
sation  with  partially  known  disturbances  and  unified  reduced-order  control  and 
estimation.  Upon  appropriate  specialization,  results  obtained  previously  for  the 
individual  problems  of  reduced-order  modelling,  estimation  and  control  are 
recovered.  An  additional  feature  is  the  inclusion  of  parameter  uncertainty  bounds  so 
that  the  necessary  conditions  for  an  auxiliary  minimization  problem  serve  as 
sufficient  conditions  for  simultaneous  robust,  reduced-order  modelling,  estimation 
and  control. 


Notation  and  definitions 

Note.  All  matrices  have  real  entries. 


R;  Rr**;  R' 
/,.(>T 

S' 

ft' 

P' 

^  Zj 
<  Z2 

asymptotically 
stable  matrix 
n,  m,  m,  /,  f,  nc,  q,  p 
n 

x,  u,  y,  y,  xc,  y„  ym,  x 
A,  A  A;  B,  A  B;  C,  AC 
Aj>  Bf,  C, 
*,• 
A, 

Ac,  Bc,  Bm ,  Cc,  Ce,  Cm 
B,  C 


L 


real  numbers;  r  x  s  real  matrices;  Rr  x  1 

rxr  identity  matrix,  transpose 

Kronecker  sum;  Kronecker  product  (Brewer  1978) 

r  x  r  symmetric  matrices 

r  x  r  symmetric  non-negative-definite  matrices 

r  x  r  symmetric  positive-dCinite  matrices 

Z2-Z,eft',  Zl,Z2eS' 

Z2-ZlePr,  Zi,ZzeS' 

matrix  with  eigenvalues  in  open  left  half-plane 
positive  integers 
n  +  nc 

n,  m,  /,  [,  nc,  q,  f,  n-dimensional  vectors 
n  x  n  matrices;  n  x  m  matrices;  /  x  n  matrices 
n  x  n,  n  x  m,  l  x  n  matrices,  i  =  1, ...,  p 
positive  numbers,  i  =  1, ...,  p 

A  +  ^  f  Sitx,I„ 

z  i  =  i 

nc  x  n„  nc  x  l,  nc  x  m,  m  x  n„  q  x  nc,  fxnc  matrices 
n  x  m,  l  x  n  matrices 

i 

4  +  i  I  <W..e 

i= i 

q  x  n  matrix 
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R 

A 

R. 

R* 

Ru 

*<  • ) 

• ) 

»,( • ) 
K 
K 

Ki 

v 

E 


A 


-KO 

P 


estimation-error  weighting  to  P* 
model-error  weighting  tn  P 
suite  weighting  matrix  to  #* 
control  weighting  nutm  tn  P* 

n  x  m  cross  weighting  matrix  such  that  A,  -  A,. A.  *A’; 

>0 

m-dimctmonal  white  ootte  independent  of  »,t  ■  t  »nd 

Wj(  • ) 

is-dimenstooai  white  ooise 
/-dimensional  white  noise 
intensity  of  *►,<  •  1  in  ft* 
intensity  of  »,(  •  1  in  P 
n  m  I  crosa  intensity  of  »,(  •).«*,(  •  I 
intensity  of  «<  • )  in  P“ 
expected  value 


[A  SC,  “I  r  A  A  AW.1 

B,C  A,  J‘[b,AC  0  J 

[A,  s-L’AL+  R,,C.  -  L'RC.  <*’*(„  1 

C,T A { ,  -  C]RL  -  C'mAC  C'  R}C,  ♦  C]  RC.  ♦  C'mAcm J 


6m  n 

BmMi\ 


[w,(tl  +  l 

f  v,  +  6v6'  t,,#  +  6vbI  1 


1.  latrodwctioa 

The  problems  of  quadraitcally  optimal  reduced -order  modelling,  estimation  and 
control  have  been  treated  in  a  common  framework  by  Hyland  and  Bernstein  ( 19*5). 
Bernstein  and  Hyland  (1985).  and  Hyland  and  Bernstein  (19*4).  respectively 
Specifically,  by  carrying  out  a  judicious  transformation  of  variables,  it  was  shown  that 
the  necessary  conditions  for  optimality  could  be  cast  as  coupled  systems  of  1  3  and  4 
modified  Lyapunov  and  Riccati  equations,  respectively  The  coupling  »  via  an  oblique 
projection  (i.e.  idempotent  matrix)  which  arises  as  a  direct  consequence  of  optimality 
and  which  determines  the  geometric  structure  of  the  reduced-order  model,  estimator, 
or  compensator.  When  the  order  of  the  estimator  or  compensator  is  set  equal  to  the 
order  of  t  plant,  the  additional  modified  Lyapunov  equations  drop  out  and  the 
remaining  modified  Riccati  equations  reduce  to  the  standard  steady-state  Riccati 
equations  of  Kalman  filter  and  LQG  theory 

An  immediate  benefit  of  this  formulation  of  the  necessary  conditions  is  clarifi¬ 
cation  of  the  relationship  between  the  operations  of  model  reduction  and  estimator  or 
controller  design.  Specifically,  although  the  additional  pair  of  modified  Lyapunov 
equations  arising  in  the  reduced-ordeT  estimation  and  control  problems  are  analo¬ 
gous  to  the  pair  of  modified  Lyapunov  equations  characterizing  (he  optimal  reduced- 
order  model,  these  equations  are  now  inextricably  coupled  with  the  modified  Riccati 
equations  characterizing  the  estimator  and  controller  design  Hence,  because  of  the 
coupling,  this  approach  is  distinct  from  LQG  controller-reduction  techniques  (see.  for 


L<u/w<4  optimal  profit  turn  eqwurioKi 
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example,  Liu  and  Anderson  19*6,  and  joeckhccre  and  SJvermxn  19fc)i  A  com¬ 
parison  between  the  LQO  reduction  method*  reviewed  b)  Liu  and  Anderson  1 19*6) 
and  the  optimal  projection  approach  has  been  given  by  Greeley  and  Hyland  ( 19*81 
The  goal  of  the  present  paper  it  to  unify  the  result*  obtained  previously  for 
reduced-order  modelling,  estimation  and  control  by  deriving  a  tingle  result  »h*ch. 
upon  appropriate  specialization,  yield*  the  reduced-order  modelling,  estimation  and 
control  results  as  special  cases  This  it  accomplished  by  defining  a  genrraiuad 
performance  functional  which  incorporates  features  of  all  three  entena  Thu*  the 
optimization  problem  involves  determining  a  tingle  reduced-order  lystem  which 
simultaneously  serves  as  a  reduced-order  model,  estimator  and  controller  (or  any  two 
of  these  as  desired)  The  necessary  condition*  now  take  the  form  of  a  coupled  system 
of  two  modified  Lyapunov  equations  and  two  modified  Rxxafi  equation*  which  can 
be  specialized  to  the  necessary  conditions  obtained  previously  for  the  reduced -order 
modelling,  estimation  and  control  problems 

There  arc  several  motivation*  for  developing  a  unified  formulation  encompassing 
all  three  results  For  example,  in  the  full-order  case  the  certainty  equivalence  principle 
implies  that  the  states  of  the  optimal  dynamic  compensator  ate  also  optimal  estimates 
of  the  plant  states  Thu  u  definitely  not  the  case  for  an  optimal  reduced-order 
controller  in  which  (he  states  may  bear  no  resemblance  to  the  plant  states  The  unified 
formulation  of  the  present  paper,  however,  expresses  the  desire  that  compensator 
states  also  provide  estimates  of  selected  plant  stales  Of  course,  except  in  the  full- 
order  case,  such  a  compensator  will  generally  be  suboptima]  from  a  strictly  control 
point  of  view  since  the  design  also  serves  as  an  estimator  A  similar  formulation  has 
been  considered  by  Wilson  and  Kumar  ( 1983) 

Additional  problems  which  can  be  handled  in  the  unified  setting  involve  reduced 
order  estimation  and  control  m  the  presence  of  partially  known  plant  disturbances 
When  measurements  of  disturbance  components  are  available  during  real-time 
operation,  such  measurements  can  be  used  as  inputs  to  the  estimator  or  controller  to 
improve  performance.  Note  that  this  problem  incorporates  aspects  of  the  model- 
reduction  formulation  in  which  the  same  white  none  signal  u  injected  into  both  the 
plant  and  the  design  system. 

A  practical  motivation  for  the  unified  problem  setting  is  convenience  in  developing 
numerical  algorithms  for  treating  different  problems  la  particular,  a  single  algorithm 
for  solving  the  unified  optimal  projection  equations  can  readily  be  used  for  all  specisl 
cases  without  reprogramming  (For  discussions  of  numerical  algorithms  for  the 
optimal  projection  equations,  see  Greeley  and  Hyland  1988.  and  Richter  1987 ) 

An  additional  feature  of  the  results  given  herein  ts  the  treatment  of  parametric 
uncertainty  in  the  plant  matrices.  By  bounding  the  effects  of  parameter  uncertainty  on 
worst-case  system  performance,  the  necessary  conditions  for  optimality  effectively 
serve  as  sufficient  conditions  for  robust  stability  and  performance  A  similar  approach 
has  been  carried  out  by  Bernstetn  and  Haddad  (1988).  using  structured  stability 
radius  bounds.  In  the  present  paper  we  use  an  alternative  bound  which  corresponds  to 
a  right  shift  of  the  dynamics  matrix  (or  equivalently,  an  exponential  cost  weighting)  in 
conjunction  with  multiplicative  white-noise  type  terms.  The  effect  of  multiplicative 
noise  on  the  optimal  projection  equations  has  been  developed  by  Bernstein  and 
Hyland  ( 1988).  In  the  present  paper  such  underlying  interpretations  will  be  suppres¬ 
sed  since  only  the  bound  per  se  will  be  needed.  Hence,  although  we  use  the  phrase 
'multiplicative  white  noise'  for  convenience  in  referring  to  the  type  of  bound  used,  it 
should  be  stressed  that  our  treatment  of  parameter  uncertainty  is  wholly  determin¬ 
istic.  (See  Bernstein  1987a.  and  Haddad  1987,  for  further  background  and  discussion.) 
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1  SiwdUMOM  rrdwctd  order,  robot*  aodcliag,  MtiwdM  mad  control 

In  (hit  tection  we  stale  the  'robust  performance  problem'  for  simultaneous 
reduced-order  modelling,  estimation  and  control  along  with  related  notation  for  later 
use.  Let  U  c  R"#  x  R**“  x  R‘*“  denote  the  set  of  uncertain  perturbations 
(AA,  AS,  AO  of  the  nominal  system  matrices  A,  B  and  C 

Robust  performance  problem 

For  fixed  n,  <  n,  determine  (>4,.  B,.  Bm,  C„  C,.  C.)  such  that,  for  the  augmented 


system  consisting  of  the  nth-order  controlled  and  disturbed  plant 

i(r)  m(A  +  AA)x(i)  +  (B  +  AB)i4t)  +  6*U)  +  w,(t),  refO.x)  (2.1) 
with  noisy  and  non-noisy  measurements 

>40  -  (C  +  AC)xf  r)  +  w,(r)  (2.2) 

y(i)-CxU)  (23) 

and  n.th-order  design  system 

i,(r)  -  A,x,U)  +  B,yit)  +  fl.MD  (2.4) 

u(r)  -  C,x,(r)  (25) 

y,(t)  -  C,x,(t)  (26) 

y.(t)  -  C.x,(r)  (27) 

(he  performance  criterion 

J{  A„B'.  Bm,  Ct.C'.Cm)*J'  +  J.  +  Jm  ( 28) 

is  minimized,  where 

J,  4  sup  lim  sup  E[xT(r)R,x(i)  +  2xT(t)R,ju(r)  +  uT(r)ft,u(f)]  (29) 

i4A.&a.sci«u  t  -  a 

J.R  sup  lim  sup  E[Lx(r)  -  y,(r)]TK[Lx(r) ->•,(()]  (210) 

(U&tAOfU  l-** 

Jm*  sup  lim  sup  E[y(r)  -  y„(r)]T £[>(()-  y«(f)]  (211) 

iaa&*ao<u  t-s 


Remark  21 

Suppose  there  are  no  uncertainties  present.  i.e.  Ad,  A 8.  AC  «  0.  By  setting  L  -  0 
and  C  »  0,  it  follows  that  J.  and  Jm  play  no  role  in  the  optimization  problem  when  C, 
and  C,  are  both  taken  to  be  zero.  As  will  be  seen  in  Theorem  6.1.  this  is  indeed  the 
optimal  solution  in  this  case.  If,  furthermore,  6  -  0,  then  the  reduced-order  dynamic- 
compensation  problem  of  Hyland  and  Bernstein  ( 1984),  is  recovered.  If,  alternatively. 
R,=*0,  Ria*» 0,  8* 0,  6-0  and  (* « 0  then  the  reduced-order  state-estimation 
problem  of  Bernstein  and  Hyland  ( 1985)  is  obtained.  Finally,  setting  8,  *  0,  Ri}  =  0, 
L  =  0,  V,  *0,  8-0  and  C» 0  yields  the  model-reduction  problem  considered  by 
Hyland  and  Bernstein  ( 1985).  ■ 

Remark  12 

Suppose  L—  0  and  C  *0  (so  that  with  C,  and  C,  both  zero  J,  and  Jm  are 
ineffective)  but  that  6  #0.  In  this  case,  a  portion  of  the  plant  disturbance,  which  is 
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assumed  to  be  measurable  during  on-line  operation,  is  being  fed  directly  into  the 
compensator.  Hence  this  problem,  which  generalizes  that  of  Hyland  and  Bernstein 
(1984),  can  be  thought  of  as  reduced-order  dynamic  compensation  with  partially 
known  disturbances.  Similarly,  the  case  8,-0,  /l, ,  -  0,  B  - 0  and  C -  0  but  6*0 
provides  a  generalization  of  Bernstein  and  Hyland  ( 1985),  which  can  be  thought  of  as 
reduced -order  state  estimation  with  partially  known  disturbances. 

For  each  variation  (A/4,  AB.  AC)  e  U,  the  augmented  system  (2.1)-(25)  can  be 


written  as 

^r)-(/?  +  A^)i(r)  +  ^r).  »e[0,  oo) 

(2.12) 

where 

^t)A[XT(f)fXT(()]T 

(213) 

and  w(r)  is  white  noise  with  intensity  Pe  A4. 

For  the  ‘robust  performance  problem'  the  cost  can  be  expressed  in  terms  of  the 
second-moment  matrix  of  £(r).  The  following  result  is  immediate. 


Proposition  2 1 

For  given  (/4t,  Bt,  Bm,  Ct,  C„  Cm)  and  (A/4,  A B,  AC)  e  U  the  second-moment 
matrix 

&t(0  A  E[f(f)*T(r)],  1 6  [0,  oo)  (2.14) 

satisfies 

&rflMJ  +  A^4(0  +  g^r)(/7  +  &ff)T  +  P.  t  e  [0,  co)  (115) 
Furthermore, 

J(Ae,  Bc,  Bm,  Cc,  C„  Cm) «•  sup  timsup  tr£u(r)£  (216) 

IAA.  AA  AO  •  U  I  —  od 

3.  Sofficieat  conditions  for  robnst  stability  and  performance 

In  practice,  steady-state  performance  is  only  of  interest  when  the  augmented 
system  is  stable  over  U.  The  following  result  is  immediate. 

Lemma  3.1 

Suppose  the  system  (2.12)  is  stable  for  all  (A/4,  AS,  AC)  e  II.  Then 

J(Ae,  Bt,  B„,  C„  C„  Cm)  =  sup  tr&ftf  (3.1) 

I A^.  AA  AO  t  U 

where  Qtj  e  is  the  unique  solution  to 

0  =  (A  +  A/?)^^  +  0At(^  +  A/i)T  +  P  (3.2) 


Remark  3.1 

When  U  is  compact,  ‘sup’  in  (3.1)  can  be  replaced  by  ‘max’. 

Since  it  is  difficult  to  determine  J{AC,  Bf,  B„,  Cc,  C„  CJ  explicitly,  we  shall  seek 
upper  bounds. 
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Theorem  3.1 

Let  Q:  A'  x  R***'  x  be  such  that 

Ay?Q  +  QAXy  <  0(0,  B{,  Cf ) 

(AA,  AB,  AQ  e  U,  (Q,  Be,  Ce)  e  ft4  x  R***'  x  R-"**  (3  3) 

and,  for  given  (Ac,  Be,  Bm,  Ct,  C„  Cm),  suppose  there  exists  Q  e  ft'  satisfying 

0  =•>  4-  Q^T  +  0(0,  B(,  C{)  +  9  (3.4) 

Furthermore,  suppose  the  pair  ( 9l/i,  A  +  Ai)  is  detecUble  for  all  (AA,  A B,  AC)  e  U. 
Then  X  +  AX  is  asymptotically  stable  for  all  (AA,  A B,  AC)  e  U, 

GaA  ^  Q.  (AA,  AB,  AC)  e  U  (3.5) 

and 

J{A„  Be,  Bm,  Ct,  C„  Cm)  K  tr  Q/T  (3.6) 


Proof 

For  all  (AA,  AB,  AC)  e  U,  (3.4)  is  equivalent  to 

0  =  (X  +  Ay?)Q  +  Q(/f  +  A/J)T  +  4»(a  Bc,  Cc,  A/f)  +  9  (3.7) 

where 

¥(0,  Bc,  Ce,  AX)  A  0(a  Bt,  Ct)  -  (A^Q  +  QAiT) 

Note  that  by  (3.3),  H'(Q,Bc,C„Ai)^0  for  all  (AA,  AB,  AQ  6  U.  Since  (9l,2,X 
+  A  A)  is  detectable  for  all  (A A,  AB,  AC)  e  U,  it  follows  from  Theorem  3.6  of  Wonham 
(1979),  that  ((9  +  ^(0,  Be,  Ct,  AX))112,  X  +  AX)  is  detectable  for  all 
(AA,  AB,  AC)  e  U.  Hence  Lemma  12.2  of  Wonham  (1979),  implies  that  X  +  AX  is 
asymptotically  stable  for  all  (A A,  AB,  AQ  e  U. 

Next,  subtracting  (3.2)  from  (3.7)  yields 

0  =  (X  +  Ai?)(Q  -  &*)  +  (Q  -  Qn){A  +  AX)r  +  4»(Q,  Be,  Cc,  AA) 

or,  equivalently  (since  X  +  AA  is  asymptotically  stable), 

Q  ~  (Lt  =  |  exp  (X  +  A X)t  ¥(0,  Be,  Cc,  AX)  exp  (A  +  AA)rr  dt  >  0 

which  implies  (3.5).  Finally,  (3.5)  and  (3.1)  yield  (3.6).  □ 

Remark  3.2 

For  the  dynamic-compensation  problem  the  result  that  X  +  AX  is  asymptotically 
stable  for  all  (AA,  AB,  AQ  e  U  is  equivalent  to  robust  stability  of  the  closed-loop 
system.  For  the  state-estimation  and  model-reduction  problems,  however,  A  +  AA  is 
lower  block  triangular  (since  B  =  0)  and  block  diagonal  (since  C  =  0),  respectively. 
Thus  robust  stability  is  equivalent  to  Ac  stable  and  A  +  AA  stable  for  all 
(AA,  AB,  AQ  e  U. 

We  also  note  a  sufficient  condition  for  the  solution  Q  of  (3.4)  to  be  positive 
definite. 
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Proposition  3.1 

Let  Q  be  as  in  Theorem  3.1,  let  (An  B„  C„  C„  CJ  be  given,  and  suppose  there 
exists  OeA*  satisfying  (3.4).  If  ( P112,  A  +  aA)  is  observable  for  some 
(A4,  AB,  AC)  €  U,  then  Q  is  positive  definite. 

Proof 

If  ( P'112,  A  +  A/?)  is  observable  for  some  (A/4,  A B,  AC)  e  U,  then,  by  Theorem  3.6 
of  Wonham  (1979),  ((P  +  ¥(0,  B„  C„  A/I))l/J,  A  +  A,?)  is  also  observable  for  the 
same  (A/4,  AB,  AC)  e  U.  It  thus  follows  from  (3.7)  and  Lemma  112  of  Wonham 
(1979),  that  Q  is  positive  definite.  □ 

Remark  3.3 

If  9  is  positive  definite  then  the  detectability  and  observability  hypotheses  of 
Theorem  3.1  and  Proposition  3.1  are  automatically  satisfied. 

Remark  3.4 

Theorem  3.1  can  be  strengthened  by  noting  that  the  detectability  assumption  is,  in 
a  sense,  superfluous.  To  see  this,  first  note  that  robust  stability  concerns  only  the 
undisturbed  system  while  9  involves  the  disturbance  noise.  Hence  robust  stability  is 
guaranteed  by  the  existence  of  a  solution  Qe  A*  satisfying  (3.4)  with  9  replaced  by  */„ 
for  some  at  >  0.  For  this  replacement  detectability  is  automatic  (see  previous  remark). 
For  robust  performance,  however,  Q  in  (3.5)  must  be  obtained  from  (3.4). 

4.  Uncertainty  structure  and  right  shift  multiplicative  white  noise  bound 
The  uncertainty  set  U  is  assumed  to  be  of  the  form 

U  =  {(AX,  AB.AQeR'-x  R'—x  R'-: A/t*  £  o,Ah 
L  <-i 

A B=  £  <r,B„  A C=  £  ff,C„  |<r,|«<5„  i*l,...,p 

i  <-i 

where,  for  i  =  1,...,  p-.  At e  R**",  B,sR"x*  and  Cfe  R',<*  are  fixed  matrices  denoting 
the  structure  of  the  parametric  uncertainty;  5,  is  a  given  uncertainty  bound;  and  a,  is 
an  uncertain  real  parameter.  The  closed-loop  system  thus  has  structured  uncertainty 
of  the  form 

A/?=  £  o,A , 

(- 1 

where 


To  obtain  an  explicit  gain  expression  for  (Ae,  Bc,  Bm,  Cc,  C„  Cm)  we  require  that 

[B, ^0=>C,  =  0],  i=l . p  (4.3) 

That  is,  for  each  i  e  { 1, ....  p)  either  B,  or  C,  is  zero.  Of  course,  both  B,  =  0  and  C,  =  0 
are  possible  for  a  given  i,  and  there  are  no  restrictions  on  A,. 
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Given  the  structure  of  U  defined  by  (4.1)  we  can  define  the  bound  satisfying  (3.3). 
Proposition  4.1 

Let  ....  a,  be  arbitrary  positive  scalars.  Then  the  function 

0(0,  Be,  Ce)  =  £  <$i(a,Q  +  of (4.4) 

i- i 

satisfies  (3.3)  with  U  given  by  (4.1). 

Proof 

Note  that 

0<[<rl(al/d,)l/2/1.-(^M),'J^]Q[^(*i/^),/2/*-(<5<M)‘,I^]T 
=  of(a,/6,)Q  +  (d,/at)A,QAl  -  ot(AtQ  +  Qi,T) 
which,  since  of  <  Sf,  implies  (3.3).  □ 

5.  Auxiliary  minimization  problem 

Rather  than  minimize  the  actual  cost  (2.8),  we  shall  consider  the  upper  bound 
(3.6).  This  leads  to  the  following  problem. 


Auxiliary  minimization  problem 

Determine  (Ac,  Bc,  Bm,  Cc,  C„  Cm)  and  Q  6  which  minimize 


J(/fc,  Bc,  Bm ,  Ct,  C„  C*,  Q)  £  tr  qR 

(5.1) 

subject  to 

0 =  AQ.  +  QAr  +  £  <5,(«iQ  +  <xf 1  ^CL?,7)  +  9 

f  ■  1 

(5.2) 

and 

( 9 »«,  A  +  AA)  is  detectable,  (AA,  AB,  AC)  e  U 

(5.3) 

Proposition  5.1 

If  ( Ac ,  Bc,  Bm,  Ce,  Ce,  Cm,  Q)  is  admissible,  i.e.  ( Ac ,  Bc,  Bm,  Cc,  C„  Cm,  Q)  satisfies 
(5.2)  and  (5.3),  then  A  +  AA  is  asymptotically  stable  for  all  ( AA ,  A B,  AC)  e  U  and 

J(A„  Bn  B„  Ca  Ct,  Cm)  <  J(AC,  Bc,  Bm,  Cc,  C„  Cm,  Q)  ( 5.4) 


Proof 

With  D  given  by  (4.4),  Proposition  4.1  implies  that  (3.3)  is  satisfied.  Furthermore, 
admissibility  implies  that  (3.4)  has  a  solution  Q  6  Kl’i.  Hence,  with  (5.3),  the 
hypotheses  of  Theorem  3.1  are  satisfied  so  that  robust  stability  with  the  performance 
bound  (3.6)  is  guaranteed.  Note  that  with  the  definition  (5.1),  (5.4)  is  merely  a 
restatement  of  (3.6).  □ 

6.  Necessary  conditions  for  the  auxiliary  minimization  problem 

The  derivation  of  the  necessary  conditions  for  the  ‘auxiliary  minimization 
problem’  is  based  upon  the  Fritz  John  form  of  the  Lagrange  multiplier  theorem. 


Unified  optimal  projection  equations 


1125 


Rigorous  application  of  this  technique  requires  additional  technical  assumptions. 
Specifically,  we  further  restrict  ( Ae ,  Be,  Bm,  Cc,  C„  Cm)  to  the  set 

S  £  {(/4C,  Bc,  Bm,  Cc,  C„  Cm,  Q)  :Q  e  P*,  A  is  asymptotically  stable,  and 

(v4c,  Bc,  Cc)  is  minimal} 

where 

A  —  +  2  +  2  ^  yMi®  At 

with,  for  convenience, 

7i  -  /<*< 

The  following  observation  assures  us  that  we  can  apply  Lagrange  multipliers  over  an 
open  constraint  set. 

Proposition  6.1 

The  set  S  is  open. 

Proof 

It  need  only  be  noted  that  S  is  the  intersection  of  three  open  sets.  □ 

Remark  6.1 

The  constraint  (Ac,  Bc,  Bm,  Cc,  C„  C„,  Q)  6  S  is  not  required  for  either  robust 
stability  or  robust  performance.  As  can  be  seen  from  the  proof  of  Theorem  6.1  in  the 
Appendix,  the  set  S  constitutes  sufficient  conditions  under  which  the  Lagrange 
multiplier  technique  is  applicable  to  the  ‘auxiliary  minimization  problem’.  Specifi¬ 
cally,  asymptotic  stability  of  A  serves  as  a  normality  condition  which  further  implies 
that  the  dual  P  of  Q  is  non-negative  definite.  Furthermore,  (Ac,  Bc,  Cc)  minimal  is  a 
nondegeneracy  condition  which  implies  that  the  lower  right  nc  x  nc  subblocks  of  Q 
and  P  are  positive  definite.  It  is  extremely  important  to  emphasize  that  Proposition 
5.1  implies  that  it  is  not  necessary  for  guaranteed  robust  stability  and  performance 
that  an  admissible  quadruple,  obtained  by  solving  the  necessary  conditions,  actually 
be  shown  to  be  an  element  of  S. 

For  arbitrary  Q,  P,  P  e  R"  * "  define  the  following  notation: 

Rz,  a  r2  +  1 7iBJ(p+ vu  -  vi  +  t  y«c, (Q  +  G)CJ 

i-  1  i-  1 

Q,±QCt+V12+  iy.A^Q  +  QKJ,  P i  —  BT P  +  R\2  +  + 

i-1  t*  1 

A,-  Q,Vz,1  C,  A,  4  A,  —  BR2f  P, 

The  following  factorization  lemma  is  needed  for  the  statement  of  the  main  result. 
Lemma  6.1 

If  Q,  P  e  ft"  then  Q,P  is  diagonalizable  with  non-negative  eigenvalues.  If,  in 
addition,  rank  QP  =  nc,  then  there  exist  nc  x  n  G,  T  and  nc  x  nc  invertible  M  such  that 

§P  =  GtMT  (6.1) 
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TGT  =  / (6.2) 
Furthermore,  G,  M  and  T  are  unique  except  for  a  change  of  basis  in  R"r. 

Proof 

The  result  is  an  immediate  consequence  of  Rao  and  Mitra  ( 1971),  Theorem  6.2.5, 
p.  123.  □ 

A  triple  (G,  M,  T)  satisfying  (6.1)  and  (6.2)  will  be  called  a  projective  factorization 
of  QP.  Since  QP  is  diagonalizable  it  has  a  group  generalized  inverse  (QP)'  =  GT  M  ' 1 T 
and 

T^QP(fiP)*  =  GTr 

is  an  oblique  projection.  Furthermore,  define  the  complementary  projection 

Tj.  -  f„  ~  *■ 

Theorem  6.1 

Suppose  (Ac,  Bc,  Bm ,  Cc,  Ct,  Cm,  Q)  e  S  solves  the  ‘auxiliary  minimization 
problem’.  Then  there  exist  Q,  P,Q,Pe  |Q"  such  that,  for  some  projective  factorization 
(G,  M,  T)  of  QP,  Ac,  Bc,  Bm,  Cc,  Ct,  Cm  and  Q  are  given  by 


n  A-BR2,lPa-Q,V2,lQGT 

(6.3) 

Bc  =  rQsV2~l 

(6-4) 

Bm  =  rB 

(6.5) 

Cc=  -R^P'G* 

(6.6) 

Ct  =  LGT 

(6.7) 

Cm  =  GGT 

(6-8) 

Q.r«+*  *rT] 

|_  TG  TQrJ 

(6.9) 

and  such  that  Q,  P,  Q  and  P  satisfy 

Q^A'Q  +  QAl+V^  £  y,[  AtQA]  +  (Ai-  B^,1  PMAt-  B^,1  P,)rj 

i=  1 

-  Q,  Vu 1 QJ  +  ti[  Q,  Vi, 1 Q]  +  BKBT]tI  (6.10) 

0=A]P+PAt  +  Rl+  £  7,iAjPAl  +  (At-QMV£lCifP{Ai-Q.VulCt) 

1 

-  PjRJ,1  P,  +  rltPjRJ,1  P,  +  LtRL+  CtRC]  tx  (6.1 1) 

0=APd  +  d'4r  +  C^2T1eJ  +  ^^BT-ti[CJ^71CJ+B>/BT]rI  (6.12) 

0  =  /4jP  +  P/4q  +  Pj  R2- 1  Ps  +  LrRL+CyRC-  rI[Pj P2' 1 P5  +  LTRL  +  CtRC]tx 

(6.13) 

rank  Q  =  rank  P  =  rank  @P  =  nc  (6. 14) 
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Proof 

For  the  proof  see  the  Appendix. 

Remark  6.2 

As  in  Remark  2.1  suppose  AA,  AB,AC  =  0.  By  setting  L  =  0,  B  =  0  and  C  =  0, 
(6.10)— (6. 13)  specialize  to  the  optimal  projection  equations  (2.18)— (2.21)  derived  by 
Hyland  and  Bernstein  ( 1984),  with  the  added  features  of  correlated  plant/measure¬ 
ment  noise  ( Fl2)  and  cross  weighting  (Ru).  If  Rx  =  0,  Rl2  -  0,  B  =  0,  B  =  0  and  C  =  0 
then,  since  P,=  0,  (6.11)  drops  out  and  the  remaining  equations  (6.10),  (6.12)  and 
(6.13)  specialize  to  (2.10)— (2.12)  of  Bernstein  and  Hyland  (1985).  Finally,  if  R,  =0, 
Rn  =  0,  L= 0,  F,  =  0,  B  =  0  and  C  =  0,  then,  since  Qs  =  Ps  =  0,  (6.10)  and  (6.1 1)  drop 
out  and  the  remaining  equations  (6.12)  and  (6.13)  specialize  to  (2.21)  and  (2.22)  of 
Hyland  and  Bernstein  (1985). 

Remark  6.3 

A  more  restrictive  formulation  for  unified  modelling,  estimation  and  control  is  to 
require  C,  =  C,  =  Cm  so  that  u  =  ye  —  y„.  In  this  case  the  three  outputs  of  the  design 
system  (2.4)— (2.7)  are  replaced  by  a  single  output.  Again,  the  necessary  conditions 
involve  a  system  of  four  coupled  matrix  equations  similar  to  (6. 10)— (6.13)  which 
specialize  to  previously  known  results.  Since  this  formulation  requires  m-q-f,  it 
appears  to  be  less  useful  than  the  three-output  formulation. 


7.  Sufficient  conditions  for  robust  stability  and  performance 

The  main  result  guaranteeing  robust  stability  and  performance  for  the  unified 
problem  can  now  be  stated. 

Theorem  7.1 

Suppose  there  exist  Q,  P,Q,P  e  ft"  satisfying  (6.10)— (6.14)  and  assume  (P1/2,  A 
+  A/4)  is  detectable  for  all  (AA,  A B,  AC)  6  U  with  Ac,  Bc,  Bm,  Cc,  Ct,  Cm  given  by 
(6.3)— (6.18).  Then  A  +  A/(  is  asymptotically  stable  for  all  (AA,  A B,  AC)  e  li  and  the 
closed-loop  system  satisfies  the  performance  bound 

J(A0  Bn  Bm,  C„  Ce,  CJ  <  tr  [(Q  +  £)«,  +  Pj *£* /W,1  P&  -  2Rl2R;,1P& 

+  QLtRL+Ct&C{Wc-Q )]  (7.1) 

where  the  controllability  gramian  Wc  satisfies 

0=AWc+  W'A'  +  BVB1  (7.2) 


Proof 

Theorem  7.1  implies  Q  given  by  (6.9)  satisfies  (5.2).  With  the  detectability 
assumption  the  result  follows  from  Proposition  5.1.  □ 

8.  Directions  for  further  research 

Several  generalizations  remain  to  be  explored.  These  include: 

(a)  permit  w(  • )  to  be  correlated  with  w,(  • )  and  w2(  • ); 
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(b)  replace  (2.2)  with 

y(t)  =  (C  +  AC)x(t)  +  (D  +  AD)u(t)  +  w2(r)  (8.1) 

(c)  replace  (2.4)  with 

xc(t)  =  4£xc(r)  +  Bcy(t)  +  Bnw{t )  +  w3(t)  (8.2) 

(d)  replace  (2.5)  with 

«(f)  =  CcxcU)  +  Dcy(t)  (8-3) 

The  extension  (8.3)  has  been  studied  by  Bernstein  (1987  b),  for  control  and  by  Haddad 
and  Bernstein  (1987),  for  estimation. 
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Appendix 

Proof  of  Theorem  6.1 

Partition  «xnQ,P  into  n  x  n,  n  x  n„  and  nc  x  nc  sub-blocks  as 


Q  = 


Qi2~ 

Qi  J 


and  define  the  n  x  n  matrices 


Q  —  Qi  ~QnQi  lQ^2> 

Q12QV  Oil, 


p4Pi-p12p-‘p{2 

p4p12p->p{2 


and  the  nc  x  n,  nc  x  nc,  nc  x  n  matrices 


g±qi1q[2,  m&q2p2,  r±-p;'p]2 


The  existence  of  Q2  1  and  P2  1  is  shown  below. 

Clearly,  Q,  P,  <2  and  P  are  symmetric  and  <5  and  P  are  non-negative  definite.  To 
show  that  <2  and  P  are  non-negative  definite,  note  that  Q  is  the  upper  left-hand  block 
of  the  non-negative-definite  matrix  Q *  QQ*T,  where 


Q*k 


~Q\iQi 1 


Similarly,  P  is  non-negative  definite. 

To  optimize  (5.1)  over  the  open  set  S',  where 

S'  ^  {(Ac,  Bc,  Bm,  Cc,  C„  Cm,  Q)  e  S:  (5.3)  is  satisfied} 
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and  subject  to  the  constraint  (5.2),  form  the  lagrangian 
UAe,  Bc,  3m,  Cc,  Ce,  CM,  Q,  P,  A) 

4  tr  J^.a£  +  ^4Q  +  Q^T  +  £  Si(<Xi  Q  +  af 1  At  QA? )  +  F  j  P  J 

where  the  Lagrange  multipliers  A  ^  0  and  P  e  P*  *  *  are  not  both  zero.  We  thus  obtain 
dl  2. 

—  =  /?TP  +  PA  +  V  ^(afP  +  a f 1  Aj PA,)  +  A£ 
cQ  i»  i 


Setting  dL  /SQ  =  0  yields 


AT  vec  P  =  —  A  vec  £ 


where  ‘vec’  is  the  column-stacking  operation  (see  Brewer  1978).  Since  A  is  assumed  to 
be  stable  and  thus  invertible,  A  =  0  implies  P  =  0.  Hence,  it  can  be  assumed  without 
loss  of  generality  that  A  =  1. 

Furthermore,  the  stability  of  A  implies  that  P  is  non-negative  definite.  The 
stationarity  conditions  are  given  by 

^  =  AQ  +  QAT  +  £  [<5(afQ  +  yi/4,aL4iT]+  P=0  (A  1) 

or  i*  i 

^  =  ATP  +  PiT-f-  £  [di*(P  +  y<A17PAi]  +  R  =  0  (A  2) 


—  ^12612  +  P2Q2  —0 


^  =  P2BcV2,  +  (P\2Q,  +  P1Q\2)C  +  P\1(vil+  tji*iQxci)=0  (A4> 


—  =  Pj2BV+P2BmV=0 


~  =  R2,CcQ2  +  BT(Pt  Q12  +  Pt2Q2)  +  +  £  y,Bj Px  A,)  Qi2  =  0  (A  6) 

~-  =  -RLQl2  +  RC,Ql2=0  (A  7) 

~  =  -6CQl2  +  fiCmQ2  =  0  (A  8) 

Expanding  (A  1)  and  (A  2)  yields 
0  =  AIQl+BCcQ]2  +  Q1A]  +  Ql2CjBT+  £  y, 

i  *  l 

X  [AIQ,A?  +  BtCcQ]2Aj  +  A&uCjBj  +  BtCcQ2Cj Bjj  +  V,  +  BVBJ  (A  9) 
0  =  A'Ql2  +  Qi2Al  +  BCcQ1  +  QlCrB?+  £  y^Q.Cj Bj 

i-  1 

+  Vl2B]  +  8VBl  (A  10) 

0  =  BcCQl2  +  A„Q2  +  Q]2CtB]  +  Q2Al  +  BcV2,B J  +  BmVBj,  (A  1 1) 
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0=PlAa+Pl2BeC+AjPl  +  CTBjP]2  +  £  Vl 


i»  1 


X  IA] P,  At  +  Cj B lj P]2 A,  +  Ajp12 Bc C,  4 ■  C] Bj P2BcCJ  +  Rl  +  LT RL+ CT fiC 

(A  12) 


0=  PlBCc+  P l2Aca  +  AT P 12  +  CrBjP2  4-  £  ytA JPlBiCc  + Rl2Cc 

1  =  1 

-LJRCn-CTRCm  (A  13) 

o  =  A]tP2  +  P2AC,  +  CJBtP12  +  P]2BCc  4-  CJ R2,Cc  +  CJ RCe  +  ClRCm  ( A  14) 


Lemma  A  1 

Q2  and  P2  are  positive  definite. 


Proof 

By  a  minor  extension  of  the  results  from  Albert  ( 1969),  (A  1 1)  can  be  rewritten  as 

0  =  (Aat  +  BcCQi2Qt  )Qi  +  G2(A„  +  BcCQ12Q 2  )T  +  A 

where  A  =  BcV2,Bj  4  and  Q2  is  the  Moore- Penrose  or  Drazin  generalized 

inverse  of  Q2.  Next  note  that  since  (Ac,  Bc)  is  controllable  then,  by  Theorem  3.6  of 
Wonham  (1979),  (A„  +  BcCQi2Q2 ,  A1/2)  is  also  controllable.  Now,  since  Q2  and  A 
are  non-negative  definite,  it  follows  from  Lemma  12.2  of  Wonham  (1979),  that  Q2  is 
positive  definite.  Using  (A  14),  similar  arguments  show  P2  is  positive  definite.  □ 
Since  A,  R,  R2„  K  V2„  Q2  and  P2  are  invertible,  (A  3)— (A  8)  can  be  written  as 


Bc=  -P2 


Cc  = 


v2j 


-PVP\iQx2QV  =  K' 

(A 

15) 

1 - 1 

5h 

Kl 

K5 

4-p2gT2)C  +  pT2^12  + 

£yiAiQiC]J^v2~' 

(A 

16) 

-PVPyiB 

(A 

17) 

| V(p,e 

12  ^1262)  +  (^Pl2  +  £ 

(A 

18) 

Ct  =  LQl2Q2  1 

(A 

19) 

Cm  —  £Qi2Q2  1 

(A 

20) 

Note  that  because  of  (A  15),  (6.1)  and  (6.2)  hold.  Since  Q2  and  P2  are  positive 
definite  and 

Q2P2  =  P;ilI(P'2>2Q2Pl2’I)P'2>2 

M  is  diagonalizable  with  positive  eigenvalues.  It  is  helpful  to  note  the  identities 

3  =  Q12G  =  GTQf2  =  GTG2G,  p=  -P12r=  -rTPi2  =  rTp2r  (A 21) 
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Using  (6.2)  and  Silvester’s  inequality,  it  follows  that  rank  G  =  rank  T  =  rank  Ql2 
=  rank  Pl2  =  nc  which  in  turn  imply  (6.14). 

The  components  of  Q  and  P  can  be  written  in  terms  of  Q,  P,  Q,  P,  G  and  F  as 


Qi  =  Q  +  Q,  p,  =  p+p 

(A  25) 

Gi2  =  GrT,  p12=-pgt 

(A  26) 

Q2  =  rc>rT,  p2  =  gpgt 

(A  27) 

The  gain  expressions  (6.3) -(6. 8)  and  (6.9)  follow  from  (A  16)— (A  20)  and  the 
definition  of  Q.  Substituting  (A  25)-(A  27)  into  (A  9)-(A  14)  yields 

0  =  A'Q  +  QAl+Vl+BVBr+  £  yt 

i=  1 

x  [ AtQAj  +  (A,  -  BtRj, 1  P,)Q(*i  ~  B 1  P 1)T]  +  APQ  +  QA j  (A  28) 

0  =  [APQ  +  Q(rrAj,G  +  CT  V2~  1QJ)  +  Qs  V2~ 1  Qj  +  BVBT]rT  (A  29) 

0  =  [(GtAcx r  +  Qs  V2~ 1 QQ  +  Q(GrA" T  +  Q,  Vfs '  C)T  +  Q,  Vfs  1  Qj  +  BVBr] rT 

(A  30) 

0=ArIP  +  PAx+Rl+LrRL+CrRC+  £  y, 

i=  1 

X  [Af  PA(  +  (Ai-Qa V2- 1  CfPiA,  -  Qa  V2~a  1 C,)]  +  ArQP  +  PAQ  (A  31) 

0=  [AtqP+  P(GTAcxr+  BR2a'Pa )  +  PjR^P,  +  LTRL+  CTRCjGJ  (A  32) 

0  =  G[(GrA„r  +  BR2a> 1  P,)'P  +  P(CTAcar  +BR2-'  Pa)  +  Pj  R2al  Pa  +  URL 

+  CtRC]Gt  (A  33) 

Next,  computing  either  T(  A  29)  -  (A  30)  or  G(A  32)  -  ( A  33)  yields  (6.3).  Substituting 
this  expression  for  Ac  into  (A  28),  (A  29),  (A  31)  and  (A  32)  and  using 

(A  28)  +  GTr(A  29) G  -  (A  29)G  -  (A  29  G)T 

and 

GTr(A  29)G  -  (A  29 )G  -  (A  29  G)T 
yields  (6.10)  and  (6.12).  Using 

(A31)  +  rTG(A32)r-(A32)r-(A32r)T 
and 

rTG( A  32)r  -  (A  32)T  -  (A  32  T)T 

yields  (6.1 1)  and  (6.13). 

Finally,  to  show  that  the  preceding  development  entails  no  loss  of  generality  in  the 
optimality  condition  we  now  use  (6.3)— (6.14)  to  obtain  (A  l)-( A  8).  Let  Ac,  Bc,  Bm,  Cc, 
Ce,  Cm,  G,  T,  r,  Q,  P,  Q,  P,  Q  be  as  in  the  statement  ofTheorem  6.1  and  define  Qit  Qi2, 
Q 2,  P i,  P\2,  P2  by  (A25)-(A  27).  Using  (6.2)  and  (6.4)— (6.8)  it  is  easy  to  verify 
(A  4)-(A  8).  Finally,  substitute  the  definitions  for  Q ,  P,  Q,  P ,  G  and  T  into 
(6. 10)— (6. 1 3),  reverse  the  steps  taken  earlier  in  the  proof  and  use  (6.3)  (6.8)  to  obtain 
(A  1)  and  (A  2),  which  completes  the  proof.  □ 
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of  robust  reduced-order  estimation  and  control  in  the  presence  at  real¬ 
valued.  structured  parameter  uncertainty  This  was  accomplished  b> 
incorporating  die  quadratic  uncertainty  bound  proposed  in  (7)  within  the 
optima]  projection  framework 

The  purpose  o f (he  present  note  u  to  complete  dits  cycle  of  results  by 
similarly  extending  the  results  of  (1).  Our  goal  is  thus  to  obtain  robust 
reduced-order  models  over  a  specified  range  of  parametric  plant 
uncertainty.  As  ui  (4|-(6|,  the  main  idea  is  to  bound  die  effect  of  die 
uncertain  parameters  on  (he  model -reduction  error  over  die  uncertainty 
range  and  then  determine  a  reduced-order  model  which  minimizes  die 
model-reduction  bound  The  resulting  generalization  of  the  optimal 
projection  equations  now  serves  as  a  sufficient  condition  for  robust  model 
reduction  by  virtue  of  die  fact  that  a  bound  on  the  model-reduction  error 
is  being  minimized  rather  than  the  model -reduction  error  itself  These 
optimality  conditions  now  compose  a  coupled  system  of  three  algebraic 
maim  equations  which  reduce  to  die  result  of  ( 1 1  when  the  uncertainty 
bounds  are  absent 


II  Notation  and  Definitions 


Robust  Reduced-Order  Modeling  Via  the  Optimal 
Projection  Equations  with  Petersen-Hollot  Bounds 

WASSIM  M  HADDAD  and  DENNIS  S-  BERNSTEIN 

Abstract — An  optimal  reduced-order  — dsMng  problem  vM  paramet¬ 
ric  ptaai  a  ween  aim  >  is  considered.  A  modal-reduction  bound  suggested 
by  recent  work  of  Petersen  and  Hollo!  is  ulitizrd  for  guaranteeing  robust 
reduced-order  modeling  over  a  specified  range  of  ancertaia  parameters. 
Necessary  conditions  which  generalize  the  optimal  projection  equations 
for  model  red  net  ion  are  ased  to  characterize  the  reduced -order  model 
which  minimizes  the  mosleLredudion  hound.  The  optimality  equations 
thus  effective!}  serve  as  sufficient  conditions  for  characterizing  robust 
reduced-order  models. 


n.  n'“.  n' 

L  (  >r.  i 


»'.  W\  P’ 


a,  /f  tim,  aij  if 

x.  y,  ym.  x..  S 
A.  AA;  B.  C 

A..  Bm.  C. 

A.  A  A,  B 


real  numbers,  r  x  s  real  matrices,  ft"’ 
r  x  r  identity  mains,  transpose,  expected  value 
Kronecker  sum 

r  x  r  symmetric,  noonegative -definite,  positive  - 
de finite  matrices 

Z,  -  Z,  e  *J\  Z,  -  Z,  €  P\  Z„  Z,  €  C' 

positive  integers,  n  ♦  nm 

n.  I.  I,  n„.  4 -dimens  tone!  vectors 

it  x  n  matrices,  n  x  m.  I  x  n  matrices 

nm  x  nm,  nm  x  m,  I  x  nm  matrices 


[i  ”-]  •  [V  2]  •  [i] 


R 

w<  ) 
V 


A 


9 


model -reduction  error -weighting  maim  in  P1 
m -dimensional  while  r.  -ise 
intensity  of  w(-)  in  p' 

CTRC  -CrRCm  "| 

-  CrmRC  C'RCm  J  ' 

'  BVBT  BVBT, 

B.VBT  B.VB'm 


Ul  Robust  Model -Reduction  problem 


Let  'll  C  It" "  denote  the  set  of  uncertain  perturbations.  AA  of  the 
nominal  plant  matrix  A 

Robust  Model-Reduction  Problem :  For  fixed  rt„  s  n,  determine 
(Am.  Bm,  Cm)  such  that,  for  the  system  consisting  of  the  nth-order 
disturbed  plant 

x(0-(A  +  A/<)x(M  +  flw(f).  r  €  |0.  oo).  (3.1) 


I  Introduction 


outputs 


It  has  been  shown  in  1 1  )-|3]  that  the  first-order  necessary  conditions  for 
quadraticall)  optimal  reduced-order  modeling,  estimation,  and  control 
can  be  transformed  into  coupled  systems  of  iwo,  three,  and  four  matrix 
equations,  respectively.  This  coupling  is  due  to  an  oblique  projection 
which  arises  as  a  direct  consequence  of  optimality  In  a  series  of  papers 
(4|-(A|  the  optimal  projection  approach  was  generalized  to  the  problems 


r(f)»  Cx(t). 


and  n„th-ordcr  model 


X.(0- AmXmiD*  Bm"(t). 


(3.2) 


(3.3) 

(3.4) 


Manuscript  received  August  4,  19*7;  revised  October  16.  19*7  Thu' work  wsi 
supported  in  pen  by  the  Air  Force  Office  of  Scientific  Reeesrch  under  Contract  F49620- 
I6-C-0002 

W  M  Hedded  a  with  the  Department  of  Mechenicel  Engineering  Ronds  lneoane  of 
Techooiogy.  Melbourne.  FL  32901 

D  S  Bemetein  is  with  the  Government  Aerospace  Sysiemi  Division.  Harris 
Corporation.  Melbourne.  FL  32902 
fEEF.  Log  Number  M2 101 2 


the  model -reduction  criterion 

AAm,  Bm,  Cm)  6  sup  lim  sup  I(  y(t) -/,.(/)) TR | yU) -  7.(01 

05) 

is  minimized. 
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For  each  reduced-order  model  (Am,  Bm,  Cm)  and  system  variation  XA 
€  'll.  the  augmented  system  (3. l)-(3.4)  is  given  by 

i(/)«(4  +  xA)W)  +  6w{i),  i  €  |0.  od)  (3.6) 

where  jf(/)  ft  (Jrr(f>.  *£(/)! 7 

IV.  Sufficient  Conditions  for  Robust  performance 
The  following  result  is  immediate. 

Lemma  4.1:  Suppose  Am  is  asymptotically  stable  and  A  +  XA  is 


asymptotically  stable  for  all  XA  €  'll .  Then 

J(Am.  Bm.  C„)»  sup  tr  (4.1) 

44  €> 

where  ft  lim,-«  £|.\’(Mjf(f)rl  €  W4  is  the  unique  solution  to 

0~(A  +  xA)Qu  +  QaA(Ai-xA)t+  9.  (4.2) 

We  now  determine  an  upper  bound  for  J  given  by  (4.1). 

Theorem  4. I:  Let  QiT  -•  S'*  be  such  that 

A/lft  +  ftA/IrSfl<ft),  XA  €  *U.  ft  €  H*  (4.3) 

and.  for  given  (A„,  Bm,  Cm),  suppose  there  exists  ft  €  W'*  satisfying 

0  =  /fft+ft4'r+Q(ft)  +  P  (4.4) 

and  suppose  the  pair  ( P1",  A  +  xA)  is  stabilizable  for  all  XA  £  'll. 

Then  Am  is  asymptotically  stable.  A  +  XA  is  asymptotically  stable  for  all 
A/4  G  'll. 

(?a>fSft.  XA  €  *U,  (4.5) 

where  satisfies  (4.2),  and 

J{Am,  Bm.  Cm)su  Q.R  (4.6) 

Proof:  See  (5|.  □ 


Remark  4.  1:  Theorem  4. 1  provides  sufficient  conditions  for  reduced- 
order  modeling  with  an  upper  bound  on  modeling  error.  The  result  yields, 
in  addition,  the  result  that  Am  and  A  +  XA  arc  asymptotically  stable. 
Thus,  it  is  important  to  emphasize  that  our  results  are  effectively  limited 
to  systems  which  remain  asymptotically  stable  over  the  class  of 
uncertainties  Relevant  applications  include,  for  example,  damped  flexi¬ 
ble  structures  with  uncertain  modal  data 

V  Uncertainty  Structure  and  the  Petersen -Hollot  Bound 


Proposition  5. 1:  The  function 

0(0.)  ft  £  Aw,f3,r+a£,r/J,£,Q.  (5.4) 

I  •  I 

satisfies  (4.3)  with  Tl  given  by  (5.1). 

Proof:  For  i  »  1 ,  •  •  • ,  p, 

0  S  [ 0, M,  -  ft£,' rN'\{0, M,  -  Q.£'N'l  t 

s  ft£,rjV,£ft  -  f6,M,N,£.Q.+  <l£*N*MrO*). 

Summing  over  /  yields  (4.3).  □ 

Remark  5.  1:  The  bound  (5.4)  was  originally  used  in  |7)  for  unit -rani 
perturbations  with  scalar  uncertain  parameters.  For  further  details,  see 
|4|-f6) 

VI.  The  auxiuary  Minimization  Problem 

Our  goal  is  to  minimize  the  error  bound  (4  6). 

Auxiliary  Minimization  Problem:  Determine  (ft.  Am,  Bm,  C„)  with 
ft  €  H*  which  minimize 

5(ft.  Am.  Bm.  C„)  ft  tr  ftff  (6.1) 

subject  to 

0«/tft+ft/T+2  [f5,M,Dr  +  ft£irA?,£,ft)+  P  (6.2) 

•  •  I 

and 

(P1'1.  A  +  xA)  it  stabilizable.  XA  £  Tl.  (6.3) 

Proposition  6.1:  If  (ft.  Am,  Bm.  Cm)  satisfy  (6.2)  and  (6.3)  with  ft  £ 
0.  then  Am  is  asymptotically  stable.  A  +  XA  is  asymptotically  stable  for 
all  XA  £  Tl.  and 

J(Am,  Bm,  C»)sa(ft./4..  Bm,  C_).  (6.4) 

Proof:  With  Q  given  by  (5  4).  Proposition  5.1  implies  that  (4.3)  is 
satisfied  Hence,  with  (6.3).  the  hypotheses  of  Theorem  4  I  are  satisfied 
so  that  the  system  (3.6)  is  stable  over  *U  with  model-reduction  bound 
(4.6)  Note  that  with  (6.1).  (6  4)  is  merely  a  restatement  of  (4  6)  C 

VII  NECESSARY  CONDITIONS  FOR  THE  AUXIUARY  MINIMIZATION 
Problem 


The  uncertainty  set  Tl  is  assumed  to  be  of  the  form 
Tl  =  |a,4  £  ;r  -  :  XA  =  £  D.M.N.E,.  M.MjsM,.  NjN,<.N„ 

t=l.  •  •.  pl  (5.1) 


Rigorous  application  of  the  Lagrange  multiplier  technique  requires 
additional  technical  assumptions.  Specifically,  we  further  restrict  (ft,  Am. 
Bm .  C„)  to  the  open  set 

S  ft  {(ft.  Am.  Bm,  Cm )  :  ft  €  P*.  3  is  asymptotically  stable. 

and  ( Am ,  B„.  C„)  is  controllable  and  observable} 

where 


where,  for  i  -  !,•••,  p  D,  €  fi"  '•  and  E,  £  are  fixed  matrices 
denoting  the  structure  of  the  uncertainty;  M,  £  iT'-  and  A',  £  *'J'.  are 
given  uncertainty  bounds:  and  M,  €  It''"',  N,  £  arc  uncertain 

matrices.  The  augmented  system  thus  has  structured  uncertainly  of  the 
form 

xA*^  6,M,N,£,  (5.2) 


where 


0,  ft 


.  £,  ft  (£,  oi. 


We  now  specify  the  function  Q  satisfying  (4.3). 


<J3) 


•‘H****) 

Remark  7.1:  The  constraint  (ft,  Am,  Bm,  C„)  €  S  is  not  required  for 
robust  reduced -order  modeling  since,  as  shown  by  Proposition  6. 1 ,  only 
(6.2)  and  (6.3)  are  required.  As  will  be  seen  from  the  proof  of  Theorem 
7.1,  the  set  8  constitutes  sufficient  conditions  under  which  the  Lagrange 
multiplier  technique  is  applicable  to  the  auxiliary  minimization  problem. 
Specifically,  ft  >  0  replaces  ft  £  0  by  an  open  set  constraint,  asymptotic 
stability  of  3  serves  as  a  normality  condition  which  further  implies  that 
the  dual  (P  of  ft  is  nonnegative  definite ,  and  ( Am ,  Bm,  Cm)  minimal  is  a 
nondegeneracy  condition. 

The  following  factorization  lemma  is  needed  for  the  statement  of  the 
main  result.  For  details,  see  [!}. 
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Lemma  7.1:  If  (},/•€  11*  and  rank  QP  m  n„.  then  there  exist  nm  x 
h  G,  r,  and  n„  x  nm  invertible  M  such  that 


QP-GTMT, 


(7.1) 

(7.2) 


Furthermore,  G,  W,  and  T  are  unique  except  for  a  change  of  basis  in  ,/}"». 
Recall  from  [1]  dial 


r  A  QP(QP)‘-GtT 


(7.3) 


VIII.  sufficient  Conditions  for  Robust  Reduced-Order 
Modeunc 

The  main  result  guaranteeing  robust  model  reduction  can  now  be 
stated. 

Theorem  8.1:  Suppose  there  exist  Q,  P  €  M"  satisfying  (7.8)- 
(7. 1 1 )  and  suppose  that  ( P1'1,  A  +  A  A)  is  stabilizable  for  ail  AA  €  'll 
with  Am,  Bm,  Cm  given  by  (7.5)-(7.7)  and  'll  defined  by  (5.1).  Then  Am 
is  asymptotically  stable,  A  +  AA  is  asymptotically  stable  for  all  AA  € 
V.  and  the  model -reduction  criterion  satisfies  the  bound 


is  an  oblique  projection,  where  (  )*  denotes  group  generalized  inverse. 
Define  the  complementary  projection  rA  it  /„  -  r  and  call  (G,  M,  T) 
satisfying  (7.1).  (7.2)  a  projective  factorization  of  QP.  Furthermore, 
define  the  notation 

r  r 

D  i  ]£  D.Kl.Dj.  E  a  2 

•  •  I  /-I 

Theorem  7.1:  Suppose  (ft.  A„,  B„,  C„)  €  S  solves  the  auxiliary 
minimization  problem  with  *U  given  by  (5.1).  Then  there  exist  Q.Q.PC 
W"  such  that  ft,  Am 


ft 


J{Am.Bm,Cm) s  xi  QCTRC. 


(8.1) 


Proof:  The  converse  of  Theorem  7. 1  implies  that  ft  given  by  (7.4)  is 
nonnegative  definite  and  satisfies  (6.2).  With  the  stabilizabiliry  assump¬ 
tion  the  result  follows  from  Proposition  6.1.  G 

Remark  8. 1:  As  noted  in  Remark  4. 1 .  Theorem  8. 1  is  effectively 
limited  to  systems  which  remain  asymptotically  stable  over  the  class  of 
uncertainties. 

APPENDIX 


,  Cm  are  given  by 

f-  -| 

Proof  of  Theorem  7. 1 

„  Q+Q  (?rr 

L  r$  rc?rrJ  • 

(7.4) 

To  optimize  (6. 1 )  over  the  open  set 

A.**r(A  +  QE)Gr, 

(7.J) 

S'  A  {(ft.  Am.  Bm.  Cm)  G  S  :  (6.3)  is  satisfied) 

Bm  =  TB, 

(7.6) 

subject  to  the  constraint  (6.2),  form  the  Lagrangian 

Cm  =  CGr 

(7.7) 

£(Am,  Bm.  Cm.  ft.  <P,  X)  A 

for  some  projective  factorization  (G,  M,  T)  of  QP,  and  such  that  Q.  P 
satisfy 

0  =  AQ  +  QAr+D  +  QEQ  +  Tl8VBrrri,  (7.8) 

0  =  iA  +  QE)G+QL4  +  QE)T+QEG  +  BVBT-TiBVBTT[,  (7.9) 

0  =  (/f  +QEVP+P{A+QE)  +  CTRC-TTiCrRCTi,  (7.10) 

rank  rank  £  =  rank  QP=  n„.  (7.11) 

Furthermore,  the  auxiliary  cost  is  given  by 

3(ft.  Am,  Bm.  C„)  =  tr  QCTRC.  (7.12) 

Conversely,  if  Q.Q.PC  W-  satisfy  (7.8)— (7. 1 1>  then  (ft,  Am,  B„,  Cm) 
given  by  (7.4)-(7.7)  satisfy  ft  a  0  and  (6.2)  with  auxiliary  cosl  given  bv 
(7.12). 

Proof:  See  the  Appendix.  C 

Theorem  7. 1  presents  necessary  conditions  for  the  auxiliary  minimiza¬ 
tion  problem  which  explicitly  characterize  extremals  (ft,  Am,  Bm,  C„). 
These  necessary  conditions  consist  of  a  system  of  (wo  modified  Lyapunov 
equations  and  one  modified  Riccati  equation  coupled  by  an  oblique 
projection  r  and  uncertainty  terms.  Setting  D  and  E  to  zero,  i.e. ,  deleting 
the  plant  uncertainties,  it  can  be  seen  that  (7.8)  drops  out  while  (7.9)  and 
(7.10)  reduce  to  the  optimal  projection  equations  for  model  reduction 
obtained  in  (I).  If.  alternatively,  nm  =  n,  then  the  full-order  robust  model 
is  given  by  >1  +  QE.  B.  C  where  Q  is  given  by  (7.8)  with  =  0. 

Remark  7.2:  As  in  the  perfect  modeling  case  considered  in  [1],  (7.8)- 
(7.10)  may  support  multiple  solutions.  When  uncertainty  is  present  but  a 
full-order  model  is  desired,  then  the  solution  is  unique. 

Remark  7.3:  The  conservatism  of  the  bound  (7.12)  is  difficult  to 
predict  for  two  reasons.  First,  the  overbounding  (4.3)  holds  with  respect 
to  the  partial  ordering  of  the  nonnegative-definite  matrices  for  which  no 
scalar  measure  of  conservatism  is  available.  And,  second,  the  bound  (4.3) 
is  required  to  hold  for  all  nonnegative-definite  matrices  ft.  The 
conservatism  will  thus  depend  upon  the  actual  value  of  ft  determined  by 
solving  (6.2).  Numerical  experience  with  related  bounds  shows  that  the 
conservatism  is  highly  problem  dependent.  See  [81. 


tr  ^Xftft-r  j^Aft+ft^r+^  A*,/>r  +  ft£,rA',£ft+*'j  , 

where  the  Lagrange  multipliers  X  a  0  and  (P  €  in4"*  are  not  both  zero. 
We  thus  obtain 

^«/frcP  +  (p/i+£  [£r/V,£ft<P  +  VdE'Si.E, }  +  x R . 


Setting  3£/3ft  *  0  yields 

3  r  vet  <9  «  -  X  vec  R 


(A.I) 


where  “vec"  is  the  column-stacking  operation  (see  |6]).  Since  3  is 
assumed  to  be  stable.  3  7  is  invertible,  and  thus  X  =  0  implies  (P  =  0. 
Hence,  it  can  be  assumed  without  loss  of  generality  that  X  *  I. 
Furthermore,  the  stability  of  3r  implies  that  <9  is  nonnegative  definite. 

Now  partition  n  x  n  ft.  ( P  into  n  x  n,  n  x  nm.  and  nm  x  nm 
subblocks  as 

Thus,  the  stationarity  conditions  are  given  by 


d£  p 

—  =  Ar<P  +  <PA  +  £  |£(r/V',£,ft<P  +  <Pft£fN,£)  +  /f-0.  (A. 2) 

^  »•  I 

ajc 


-P^Qn  +  PM- 0. 

^priBy+plBmy.o, 


d£ 

9Cm 


-RCQn  +  RCmQi-0. 


(A. 3) 

(A. 4) 

(A.  5) 
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Expanding  (6.2)  and  (A. 2)  yields 

0  =  AQ[  +  Q,AT+D  +  Q{EQ<  +  BVBT.  (A.6) 

0  =  AQr.  +  Ql2ATm+Q>EQi2  +  BVBTm.  <A.7> 

0=*AmQ:  +  Q:Al  +  Q  ]iEQ,}  +  B„VB*,  <  A .  8) 

0  =  A  TP,  +  P,  A  +  £(  P,  £>,  +  P,2  0, j ) r  +  ( P,  0,  +  Pl2  Q,  j  )£  +  C  rRC, 

(A. 9) 

0  =  A  'P,:  +  f>,iAm  +  £( P[2Qi  +  P2Q^)r- CTRCm.  (A.  10) 

0  =  A’„P:  +  P2Am+CrmRCm.  (All) 


Now  define  the  n  x  n  nonnegative-definitc  matrices 

Q  =  P  i 

(?  =  <?, fi-PnPi'PJi 
and  the  n„  x  n,  rr„  x  nm,  nm  x  n  matrices 

c=C:'Or:.  A/=(2:/>:.  r=  -Pj-'Pf,. 

The  existence  of  £>,  1  and  R2  '  follows  from  the  fact  that  (Am,  R„,  C„)  is 
minimal.  See  [l)-[4],  ]6]  for  details. 

Note  that  (A. 3)  implies  (7.))  and  (7.2).  Sylvester's  inequality  yields 
(7.11).  Next  (7.4).  (7.6).  and  (7.7)  follow  from  the  definition  of  £),, 
relations  (A.4)  and  (A. 5).  and  the  identities 

Qi  =  <2+<3.  <?u  =  GrT,  -PcT,  &*=  rQrT,  p,=*gPgt. 

Computing  either  T(A  7),  (A. 8)  or  G(A.IO)  +  (A  ll)  yields  (7.5). 
Inserting  (7.5)-(7  7|  into  (A.6)-(A.  1 1)  it  can  be  shown  that  (A. 8).  (A  9), 
and  (A  1 1 )  arc  superfluous.  Using  (A.6)  +  Crr<A  7)C  -  (A.7 )G  - 
((A  7>G|r  am)  CT(A.7|C  -  (A.7iG  -  l(A.7)G]7'  yield  (7.8)  and 
(7  9).  Similarly.  r'GtA.IOir  -  (A.IO)r  -  |(A.  IOiH  r  yields  (7. 10). 

Finally,  the  proof  can  be  reversed  so  that  (7.5)-(7  II)  yield  (A  1)- 
(A.5)  and  (6  2). 
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Defect  Correction  Methods  for  the  Solution  of  Algebraic 
Riccati  Equations 

V.  MEHRMANN  and  E.  TAN 

Abstract — The  solution  of  discrete  and  continuous  algebraic  Riccali 
equations  is  considered.  II  is  shown  that  it  an  approximate  solution  is 
obtained,  then  the  defect  for  this  solution  again  solves  an  algebraic 
Riccati  equation  of  the  same  form  and  that  the  system  properties  of 
detectability  and  stabilizabilily  are  inherited  by  this  defect  equation.  On 
the  basis  of  these  results,  a  general  defect  correction  method  is  proposed 
and  numerical  examples  are  given  for  the  use  of  this  method  in 
combination  with  the  SR  method. 

I.  Introduction 

We  consider  the  numerical  solution  of  generalized  algebraic  Riccali 
equation*; 

0  =  A’XE+  E-XA  -(R*.V£+S*)*R  ’(B*X£+ S-)+ C*QC  =  e<R(X) 

(1.1) 


0=  -E>XE+A'XA-(AmXB  +  S)(R+B-XB)  1 


■  (A»XB+S)’  +  C'QC=DIR(X)  (1.2) 

where X,A,E  €  St" ",  B,S  €  St" m,  C  €  £*'•",  Q  =  Q"  €  C".  R  = 
R  *  6  S'"  "  are  positive  definite  and  E  is  nonsingular.  Both  equations 
arise,  for  example,  in  the  solutions  of  linear  quadratic  optimal  control 
problems.  Equation  ( I .  I )  stems  from  a  continuous-time  and  (1.2)  from  a 
discrete-time  problem  (see,  e.g..  |1],  J4J.  and  |5)).  The  numerical 
solution  of  these  two  equations  has  been  studied  extensively  in  recent 
years  (e.g.,  [7],  14]— (61.  (9),  |14],  [16],  |17],  and  |20]).  Typically, 
solutions  are  obtained  using  QR-  or  QZ-type  algorithms  to  compute 
deflating  subspaces  of  the  matrix  pencils 


A  0B 
C*QC  A *  S 
S*  B*  R 


-A 


corresponding  to  problem  (1.1)  and 


A  0B 

C*(?C  -£•  S 

5*  OR 

L 


-  \ 


E 

0 

0 


0  ol 
-£*  0 
0  0  J 

0  0  1 
-A*  0 
-R*  oj 


(1.3) 


(1.4) 


corresponding  to  problem  (1.2).  where,  using  the  fact  thal  R  is  positive 
definite,  many  of  the  algorithms  arc  applied  to  the  reduced  pencils 


EG  .  E  0 
H  -F*  ~  0  £* 


1  A-BR  'S* 

BR  'R*  1 

-A  \E 

•1 

=  [c-QC-SR  'S*  - 

corresponding  to  ( 1.3)  and 

A*  +  SR  'fl*J 

L° 

£*  J 

[  A-BR  'S 

•l.x  r*- 

-BR 

B‘  1 

"  1  C"QC-SR  '5* 

£-J  [_0 

A* -SR 

'R*  J 

corresponding  to  (1.4). 


(I.?) 


(1.6) 
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Abstract:  A  state-estimation  design  problem  involving  parametric  plant  uncertainties  is  considered.  An  error  bound  suggested  by 
recent  work  of  Petersen  and  Hollot  is  utilized  for  guaranteeing  robust  estimation.  Necessary  conditions  which  generalize  the  optimal 
projection  equations  for  reduced-order  state  estimation  are  used  to  characterize  the  estimator  which  minimizes  the  error  bound.  The 
design  equations  thus  effectively  serve  as  sufficient  conditions  for  synthesizing  robust  estimators.  An  additional  feature  is  the 
presence  of  a  static  estimation  gain  in  conjunction  with  the  dynamic  (Kalman)  estimator,  i.e..  a  nonstrictly  proper  estimator. 

Keywords:  Robust  Kalman  filter.  Error  bounds.  Reduced-order  state  estimation. 


1.  Introduction 

As  is  well  known  [2,5-8,11,14,15]  optimal  filters  based  upon  nominal  parameter  values  may  be  severely 
degraded  in  the  presence  of  parameter  deviations.  Thus,  it  is  desirable  to  obtain  robust  state  estimators 
which  provide  acceptable  performance  over  the  range  of  parametric  uncertainty.  The  approach  of  the 
present  paper  is  related  to  the  guaranteed  cost  approach  developed  for  control  in  [4.16]  and  applied  to 
estimation  in  [11].  Specifically,  the  main  idea  is  to  bound  the  effect  of  the  uncertain  parameters  on  the 
estimation  error  over  the  uncertainty  range  and  then  choose  estimator  gains  to  minimize  the  estimation 
bound.  Thus  the  actual  estimation  error  is  guaranteed  to  lie  below  the  prescribed  upper  bound. 

The  technique  used  to  determine  minimizing  estimator  gains  is  based  upon  a  generalization  of  the 
optimal  projection  equations  for  reduced-order  state  estimation  [1],  Thus  the  results  of  the  present  paper 
effectively  extend  the  results  of  [1]  to  the  case  of  system  uncertainties.  It  should  be  noted  that  the  optimal 
projection  equations,  which  are  necessary  conditions  for  optimality,  now  serve  as  sufficient  conditions  for 
robust  estimation  by  virtue  of  the  fact  that  a  bound  on  the  estimation  error  is  being  minimized  rather  than 
the  estimation  error  itself.  The  bound  utilized  in  the  present  paper  is  an  extension  of  the  approach 
developed  in  [12,13]  for  constructing  Lyapunov  functions  for  full-state  feedback  and  utilized  in  [10]  to 
characterize  the  structured  stability  radius. 

An  additional  feature  of  the  present  paper  is  the  inclusion  of  a  static  feedback  gain  in  conjunction  with 
the  dynamic  estimator.  Thus  the  results  of  the  present  paper  represent  a  generalization  of  standard  results 
to  the  case  of  nonstrictly  proper  estimation. 

*  Supported  in  part  by  the  Air  Force  Office  of  Scientific  Research  under  contract  F49620-86-C-0002. 
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2.  Notation  and  definitions 


Note:  All  matrices  have  real  entries. 


R. 


n , 
x , 
A , 
C, 
At 

A. 


R'*MRr,  E 
(  )T 
Nr.  Pr 

~  ?2’  <  ^2 
/,  /,  nc,  p,  q\  n 

* 

4/1;  C,  4C 
Z.,  /? 

«e.  Ce.  Z?e 
A  A 


real  numbers,  rXs  real  matrices,  Rr*\  expected  value. 
r  X  r  identity  matrix,  transpose 

r  x  r  symmetric,  nonnegative-definite,  positive-definite  matrices. 

Z2  -  Z,  e  IMr,  Z2  -  Z,  e  Pr,  Z„  Z2  e  S'. 

positive  integers;  n  +  nc. 

n,  /,  1,  q,  ne,  w-dimensional  vectors. 

n  X  n  matrices;  /  X  n  matrices. 

/X  n  matrix,  q  X  n  matrix,  ^  X  q  matrix.  Re  Pq. 
n,  X nc,  n  x /,  qx  ne,  qxl  matrices. 

/<  r  ‘ 


B£ 


0 

A. 


AA 
BeAC 

LtRL  -  LJRDeC  -  CrDjRL  +  CTDjRDcC 
-  CjRL  +  CjRD.C 


-  LJRCc  +  CrDjRCc 
CjRCe 


w0(-)-  vM-) 

K-  v> 

V0l 

*(■),  V 


n,  /-dimensional  white  noise. 

intensity  of  w0(-),  »,(•);  K0eN':,  K,eP‘'. 

n  X  l  cross  intensity  of  w0(-),  w,(-). 


*M-) 

Vo  V0,  Bj  ' 

By, I  ByxBj 

3.  Robust  estimation  problem 

Let  <%e  R"x"  x  R/x"  denote  the  set  of  uncertain  perturbations  (AA.  AC)  of  the  nominal  plant  matrices  A 
and  C. 

Robust  Estimation  Problem.  For  fixed  rta  <  n,  determine  (Ac,  flc.  Q.  De)  such  that,  for  the  system 


consisting  of  the  n-th-order  disturbed  plant 

x(t)  =  (A  +  AA)x{t )  +  w0(t ),  (G  [0,  oc),  (3.1) 

noisy  and  nonnoisy  measurements 

j(/)  =  (C  +  4C)x(/)  +  w1(f),  (3.2) 

y(0  =  6c(0,  (3.3) 

and  ne-th-order  nonstrictly  proper  state  estimator 

xjr)  =*AexJt)  +  Bey(t),  (3.4) 

ye(t)‘C'Xe(t)  +  DJ(t),  (3.5) 

the  state-estimation  error  criterion 

J(  A'.  Be,  Ce.  Dt)  =  sup  lim  supE[Z.x(r)  -  re(/)]T/?[L.v(t)  -  t;.(/)]  (3.6) 

U/Uri€4'  t-x 

is  minimized. 

Note  that  the  augmented  systen  (3.1)— (3.5)  can  be  written  as 

x{t)  =  (  A  +  4/4)x(r)  +  w(i ),  te[0.  oc),  (3.7) 


where  x(t )  =  [xT(t).  xJ(t)]T.  The  cost  can  be  expressed  in  terms  of  the  augmented  second-moment  matrix. 
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Proposition  3.1.  For  given  (4e,  Bc,  Ce,  De)  and  (44,  AC)  £  <&'  the  second-moment  matrix 

CLi(04E[*(')*T(')].  1  e  [0.  oo),  (3.8) 

satisfies 

$M  =  (A+AA)Q^(')  +  Q*a('KA+AA)T +V,  t£[0.oc).  (3.9) 

Furthermore, 

J(Ae,  Bc,  Ct,  Dc)  -  sup  lim  sup  tr  Q±A‘)R-  (3.10) 

Jf)e«  t-io 


4.  Sufficient  conditions  for  robust  performance 

Lemma  4.1.  Suppose  the  system  (3.7)  is  stable  for  all  (AA,  AC)  £  fy .  Then 

J(Ae,  B',Ce,  D')~  sup  tr  Q^R.  (4.1) 

(AA.  JC) 

where  Q±g  £  (V"  is  the  unique  solution  to 

0  =  ( A+  AA)Q ^  +  Qsa(A  +  A  A?  +  V.  (4.2) 

We  now  seek  upper  bounds  for  J(AC,  Be,  Cc,  De). 

Theorem  4.1.  Let  12 :  INI’'  X  R"'x/  -»  §"  be  such  that 

AA£+£AAts  12(J.  Be).  (AA.  4C)£‘fc’,  (£.  Be)  £  IM'1  x  OT'*',  (4.3) 

and,  for  given  ( 4C,  Bc,  Ce.  Dt),  suppose  there  exists  .2  £  IM*  satisfying 

0  =  A£  +  £AT  +  Q(£,  Be )  +  V,  (4.4) 

and  suppose  the  pair  (Vi/2,  A  +  AA)  is  detectable  for  all  (A  A,  AC)  e  °l/ .  Then  4C  is  asymptotically  stable. 
A  +  A  A  is  asymptotically  stable  for  all  (A  A.  AC)  £  4S’’, 

(AA.AC)ZW,  (4.5) 

where  QA/f  satisfies  (4.2),  and 

J(AC.  B',Cc,  D')£tT2R.  (4.6) 

Proof.  For  all  (44,  AC)  £  aU,  (4.4)  is  equivalent  to 

0  =  (A+AA)£+£(A+AA)T  +*(£,  B',  44*)  +  V.  (4.7) 

where 

*(£,  B',  AA)A12(£,  Bc)  -  (AA£+£AAt). 


Note  that  by  (4.3),  'P(£.  Be.  AA)  ^  0  for  all  (AA.  4C)  £  Since  ( V'  A  +  44)  is  detectable  for  all 
(44.  AC)  £  <&.  it  follows  from  Theorem  3.6  of  (17)  that  ((V  +  '{'(£.  Se.  44))'  2.  A  +  44)  is  detectable 
for  all  (44,  AC)  £  ‘H.  Hence  Lemma  12.2  of  (17)  implies  4+44  is  asymptotically  stable  for  all 
(44.  4C)£‘2'.  Since  4+44  is  lower  block  triangular,  4C  is  asymptotically  stable  and  4  +44  is 
asymptotically  stable  for  all  (44,  AC)  £  °U.  Next,  substracting  (4.2)  from  (4.7)  yields 

0  =  ( A  +  AA)(£  -  Qu)  +  {£-  Q^)(  A  +  44*)T  +  *{£.  Be.  44*). 
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or,  equivalently,  (since  A  +  A  A  is  asymptotically  stable) 

a  -  =  fCOc(A+A/i,,'P(a,  Bt,  A  A)  e<J+A'i>T' d  t  >  0, 

which  implies  (4.5).  Finally,  (4.5)  and  (4.1)  yield  (4.6).  □ 

5.  Uncertainty  structure 

The  uncertainty  set  is  assumed  to  be  of  the  form 


=  \{AA,  AC)  (=Rnxnxn'*n:AA  =  £  Z),M,7V,£., 


i-i 


AC=  EF.M'A r.E„  <Mt,  N,TN,sN„  /  =  1 . p), 

i-i 


(5.1) 


where,  for  i  =  1, .  p,  Dt  e  R"^,  £,  e  R''x"  and  F,  e  Rlxr‘  are  fixed  matrices  denoting  the  structure  of 
the  uncertainty;  M,€Nr'  and  N)  e  IM'1  are  given  uncertainty  bounds;  and  M,  e  A/,  e  R x are 

uncertain  matrices.  The  closed-loop  system  thus  has  structured  uncertainty  of  the  form 

AA-ZbMM,  (5.2) 

i-i 


where 


A4  ^  -  AM*.  0], 

The  special  case  A/,  =  p]lr ,  A(  =  v,2/,,  is  worth  noting. 


(5.3) 


Proposition  5.1.  Let  pit  v,  >  0,  /  =  1,  —  p.  Then  M,Mf<.p*Ir  and  N^N^vfl,  if  and  only  if 
<W(M)  S  fi,  and  ^max 


RemarkS.l.  #  given  by  (5.1)  is  directly  related  to  the  structured  stability  radius  introduced  in  (10).  Setting 
p  =  1,  M{  =  pxIr ,  r,  =  s,,  Afj  =  Ir<  and  Af,  =  I ,  yields  the  setting  of  [10].  For  a  similar  formulation,  see 
(13], 


6.  The  Petersen-Hoilot  bound 

Given  <2'  as  defined  in  (5.1),  we  now  specify  12  satisfying  (4.3). 

Proposition  6.1.  The  bound  £2  given  by 
p  _ 

tt(a,Bt)  =  £  AmAt  (6.1) 

1-1 


satisfies  (4.3)  with  given  by  (5.1). 
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Proof.  For  i  =  1, . . . ,  p, 

0  <i  [  D,  M,  -  j2EJN,j  j  [  D,  M,  -  £E?NiT  ] T 
=  AM,M,TAT  +  £  E?N'TN,  E,£-{  D,  M,  N,E,£  +  £EJN,jM,tDJ  ) 

&b,Jitb?  +  £E?N,  E,£~(  a  M,  N,  E,£  +  £EjN,  tM,tDJ  ) . 

Summing  over  i  yields  (4.3).  □ 

Remark  6.1.  The  bound  (6.1)  is  used  in  [12]  for  unit-rank  perturbations  while  a  more  general  treatment 
appears  in  [13]. 


7.  The  auxiliary  minimization  problem 

Our  goal  is  to  minimize  the  error  bound  (4.6). 

Auxiliary  Minimization  Problem.  Determine  (£.  Ac,  Be,  Ce.  Dc)  with  £  e  N"  which  minimizes 

Jf(£,  Ae,  Be,Ce,  Dc)^lv£R  (7.1) 

subject  to 

p 

0  =  A£+£Ar  +  £  [D,M, Dj  +  £EjN, E,£]  +  V.  (7.2) 

i-t 

and 

(K1/2,  A  +  A  A)  is  detectable,  (AA,AC)&fy.  (7.3) 

Proposition  7.1.  If  (£,  Ae,  Bc,  Cc,  Z)e )  satisfies  (7.2)  and  (7.3)  with  £  >  0,  then  A  +  AA  is  asymptotically 
stable  for  all  (A  A,  AC)  e  fy,  and 

J(A'.  Bc,  Ce.  Dc)  <./{£,  Ae.  B „  Ce,  Dc).  (7.4) 

Proof.  With  12  given  by  (6.1),  (7.2)  is  equivalent  to  (4.4).  Hence,  with  (7.3).  the  hypotheses  of  Theorem  4.1 
are  satisfied  so  that  the  augmented  system  is  stable  over  with  estimation  bound  (4.6).  Note  that  with 
(7.1),  (7.4)  is  merely  a  restatement  of  (4.6).  □ 


8.  Necessary  conditions  for  the  auxiliary  minimization  problem 

Rigorous  application  of  the  Lagrange  multiplier  technique  requires  additional  technical  assumptions. 
Specifically,  we  further  restrict  (£,  Ae,  Bc,  Ce,  De)  to  the  set 

{(£,  As,  Bc,  Ct.  De):  ieP',  is  asymptotically  stable.  (Ae,  fie,  Ce)  is  controllable 

and  observable,  and  C(QX  -  QnQj'Qj^C1  >  0}, 

where  (©denotes  Kronecker  sum  (3)) 

A  +  £  E?Nt  E,  £  J  ©  |/f+  £  E?N,E,£ 

and  £  is  partitioned  as  in  Appendix  A.  As  shown  in  Appendix  A.  Qz  is  invertible  since  ( Ae.  Be )  is 
controllable.  The  positive  definiteness  condition  holds  when  C  has  full  row  rank  and  £  is  positive  definite. 
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As  can  be  seen  from  the  proof  of  Theorem  8.1  in  Appendix  A,  this  condition  implies  the  existence  of  the 
projection  r,  defined  below.  Note  that  £P  is  open. 

Remark  8.1.  The  constraint  (2,  Ae,  Bc,  Ce,  Dc)  ey  is  not  required  for  robust  estimation.  As  will  be  seen 
from  the  proof  of  Theorem  8.1,  the  set  y  constitutes  sufficient  conditions  under  which  the  Lagrange 
multiplier  technique  is  applicable  to  the  Auxiliary  Minimization  Problem.  Specifically,  asymptotic  stability 
of  sf  serves  as  a  normality  condition  which  further  implies  that  the  dual  &  of  2  satisfying  (A. 2)  is 
nonnegative  definite.  Furthermore,  ( Ae ,  Be,  Cc )  minimal  is  a  nondegeneracy  condition  which  implies  that 
the  lower  right  nc  x  nc  subblocks  of  2  and  5s  are  positive  definite.  It  is  extremely  important  to  emphasize 
that  Proposition  7.1  shows  that  it  is  not  necessary  for  guaranteed  robust  estimation  that  an  admissible 
quadruple  obtained  by  solving  the  necessary  conditions  actually  be  shown  to  be  an  element  of  Of. 

For  arbitrary  Q  e  R"x"  define  the  following  notation: 

Vu  4  K  +  E  fMFi\  Qs  4  ym  +  Qcy+Z  dMf,\ 

i-i  i-i 

E  t  EfN.E, ,  Ae*A-  QSu'C. 

i-i  i-i 

The  following  factorization  lemma  is  needed  for  the  statement  of  the  main  result.  See  [1]  for  details. 

Lemma  8.1.  If  Q,  P€lM"  and  rank  QP  =  ne,  then  there  exist  nex  n  G,  F  and  nc  X  invertible  M  such 
that 

QP  ~  GrM F,  FGJ=‘I„t.  (8.1), (8. 2) 

Furthermore,  G,  M  and  T  are  unique  except  for  a  change  of  basis  in  Rn‘. 

Since  QP  is  diagonalizable  it  has  a  group  generalized  inverse  (QP)U  =  GJM~'F  and 

r  =  QP(  QP)*  —  GJr  (8.3) 

is  an  oblique  projection.  Define  the  complementary  projection  rx  =  /„  -  r  and  call  (G,  M,  F)  satisfying 
(8.1)  and  (8.2)  a  projective  factorization  of  QP. 


Theorem  8.1.  (2,  Ae,  Bc,  Ce,  De)&y  is  an  extremal  of  the  Auxiliary  Minimization  problem  with  0/  given 
by  (5.1)  if  and  only  if  there  exist  Q,  Q,  PeN"  such  that  2.,  Ac.  Be,  Ce.  Dt  are  given  by 


2  = 


Q  +  Q  QFJ 

FQ  rQF T 

Ae  =  r(A-QSt-'C+QE)GT, 

K  =  FQ^\ 

Q  =  Lt,  x  Gt, 

Dc=  LQCJ(CQCr)'\ 

for  some  projective  factorization  (G,  M,  T)  of  QP,  and  such  that  Q.  Q,  P  satisfy 
0  =  AQ  +  QAT  +  V0  +  D  +  QEQ  -  Q^'Qj  +  rx  Q^’QjrJ  , 

0  =  (A  +  QE)Q  +  Q(A  +  QE)T  +  QEQ  +  Q^Ql  -  r,  QS^QM  . 

0  =  (AQ  +  QE)1  P  +  P{Aq  +  QE)  +tJ^LtRLtXx  -Tlr,TiLTRLT1±Ti  , 
rank  Q  =  rank  P  =  rank  QP  =  ne. 


(8.4) 


(8.5) 

(8.6) 

(8.7) 

(8.8) 


(8.9) 

(8.10) 

(8.11) 

(8.12) 
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where 

T,  =  QCT(CeCT)_,C,  T,.  (8.13) 

Theorem  8.1  (proved  in  Appendix  A)  presents  necessary  conditions  for  the  Auxiliary  Minimization 
Problem  which  explicitly  characterize  extremals  (2.  Ae.  Bc,  Ce,  De).  These  necessary  conditions  consist  of 
a  system  of  two  modified  Lyapunov  equations  and  one  modified  Riccati  equation  coupled  by  two  oblique 
projections  t  and  r,  and  uncertainty  terms.  The  projections  r  and  t,  correspond  to  reduced  estimator 
order  and  singular  observation  noise,  respectively. 

Several  special  cases  can  immediately  be  discerned.  For  example,  in  the  full-order  estimator  case  nc~  n, 
set  r  =  /„  so  that  rx  =0.  Now  the  last  term  in  each  of  (8.9)— (8.1 1)  can  be  deleted  and  G  and  F  in 

(8.4) — (8.7)  can  be  taken  to  be  the  identity.  Furthermore,  since  Q  and  P  now  play  no  role  in  determining 
the  optimal  estimator,  equations  (8.10)  and  (8.11)  are  superfluous.  If,  furthermore.  Dr  E,  and  F,  are  zero, 
then  (8.9)  reduces  to  the  standard  observer  Riccati  equation  of  steady-state  Kalman  filter  theory. 
Alternatively,  the  case  in  which  the  static  estimator  gain  De  is  absent  can  be  handled  by  ignoring  (8.8)  and 
setting  t,  =0.  If,  furthermore,  the  uncertainty  terms  are  deleted  then  the  results  of  [1]  are  recovered. 

9.  Sufficient  conditions  for  robust,  reduced-order  estimation 

The  main  result  guaranteeing  robust  estimation  can  now  be  stated. 

Theorem  9.1.  Suppose  there  exist  Q,  Q,  P  e  1ST  satisfying  (8.9)— (8.1 2).  let  Ac,  Bc.  Cc,  De  be  given  by 

(8.5) — (8.8).  and  suppose  that(V'/1,  A  +  A  A)  is  detectable  for  all  (A  A.  AC)  e  °U  with  °U  given  by  (5.1).  Then 
Ae  is  asymptotically  stable,  A  +AA  is  asymptotically  stable  for  all  (A  A.  AC)  e  °U,  and  the  estimation  error 
satisfies  the  bound 

J{At.  B'.C e.  £U<tr  QtJ±LtRLt1x.  (9.1) 

Proof.  Theorem  8.1  implies  2  given  by  (8.4)  satisfies  (7.2).  With  the  detectability  assumption  the  result 
follows  from  Proposition  7.1.  □ 

Remark  9.1.  Note  that  if  C  =  L  then  Cc  =  0  and  the  estimation  bound  (9.1)  is  zero  since  Cr,  x  =0.  This  is. 
of  course,  to  be  expected  since  perfect  estimation  is  achievable  in  this  case. 

Remark  9.2.  The  problem  of  designing  reduced-order,  robust  estimators  for  unstable  systems  remains  an 
area  for  future  research. 


Appendix  A:  Proof  of  Theorem  8.1 

Partition  hx  h  2,  &  into  nxn,  n  x  nt,  and  nc  x  ne  subblocks  as 


2  = 


Qi  Qm 
Qu  Qi 


<?= 


Pi 

pt 

rl2 


rn 
P , 


and  define  the  n  x  n  nonnegative-definite  matrices 
e  =  P±Pi-Pl2P2-'Pj2. 

Q-QnQVQ^  P-PnPf'P^ 

and  the  ne  x  n,  ncx  ne,  ncx  n  matrices 

g  4  Q2'Qj2.  m  =  Q2p2.  r4-p-'pT. 

The  existence  of  Q2  1  and  P{ 1  is  shown  below. 
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To  optimize  (7.1)  over  the  open  set  \  where  {(5.  Ae ,  Bt.  Ce.  Ojey:  (7.3)  is  satisfied), 
subject  to  the  constraint  (7.2),  form  the  Lagrangian 


A"  Bc,Cc,  De)  =  It 


\2R  +  (  AS+SA*  +  £  b,M,bJ  +  2EjN,E,2  +  v\& 

i-i 


where  the  multipliers  X  >  0  and  R'1*"  are  not  both  zero.  We  thus  obtain 

9^ 
ds 


^(£  P  _  __ 

=At0,+  &A  +  £  £,T(V, E,2^>  +  3P2. £  T/V; E,  +  X£. 


i  =  i 


Setting  9i^9^  =  0  yields  (‘  vec’  is  defined  in  [3]) 
jt/Tvec  —  X  vec  £. 

Since  at?  is  assumed  to  be  invertible,  X  =  0  implies  0=0.  Hence,  without  loss  of  generality,  set  X  =  1. 
Since,  furthermore,  sf  is  assumed  to  be  asymptotically  stable,  &  is  nonnegative  definite.  The  stationarity 
conditions  are  given  by 


p  _  _ 

-r-  =  AS  +  2  A*  +  £  D,M, Dj  +  2E?N, E,2+V  =  0, 

,-i 

p  —  — 

-jjg»sFP+0A  +  £  E?N,EI2&>+9>2E7NIEI  +  r  =  0. 

/“I 

Jt'-PhQn  +  PiQi-  0, 

Jg  =  pJ:V0)  +  ( PlQy  +  PjQL)CT  +  P25eF)3  =  0. 

~  =  -  ££2n  +  «Z)eC^12  +  £Cc{?:  =  0. 

||-  -  -  «£<2,CT  +  RD'CQ.C1  +  RC,Ql:C7  =  0. 

Expanding  (A.l)  and  (A.2)  yields 

o  =  aq1  +  q,at  +  d  +  q,eq,+  y0. 

0  =  AQ,  2+  Q,CrBcT  +  QnA  1  +  £,££,;  +  VmBj. 

0  =  B'CQU  +  A'Q2  +  Qj2CTBj  +  Q2Aj  +  B'Vtj  Bj  +  Qj2EQi2. 

0  =  puAc  +  AJPn  +  CTBjP2  +  £(  P7:Q,  +  P2Q72  )T  -  LJRCc  +  CJDjRCe. 
0  =  P2Ac  +  a]p2  +  C'TRC'. 


(A.l) 
(A.2) 
(A. 3) 
(A. 4) 
(A. 5) 
(A.6) 


(A. 7) 
(A. 8) 
(A. 9) 
(A. 10) 
(A. 11) 


Note  that  the  (1.1)  subblock  of  equation  (A.2)  characterizing  £,  has  been  omitted  from  the  above 
equations  since  the  estimator  gains  are  independent  of  £,.  Writing  (A. 9)  as  (see  [1.9]) 

0  =  ( At  +  B'CQUQ;  )Q2  +  Q2(  At  +  BeCQi2Q2  )T  +  Q2(QnQ2  )TEQi2Q2Q2  +  BJuBj 

where  Q2  is  the  Moore-Penrose  or  Drazin  generalized  inverse  of  Q2,  it  follows  from  [17],  Lemmas  2.1 
and  12.2.  that  Q2  is  positive  definite.  Similarly.  (All)  implies  that  P2  is  positive  definite. 

Next  (8.4),  (8.6)— (8.8)  follow  from  the  definition  of  2.  (A.4)-(A,6)  by  using  the  identities 

£?,  =  £?  +  {?•  p,  =  p  +  p.  £>i;  =  QrT.  p12=  -pgt.  Q2  =  rQrT.  P2  =  GPG t. 


I 
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Computing  either  T(A  8)-(A  *J)  of  GlA  10)  »  iA  li>  >*ti>  eS  7t  lu>nioijt  t»  >>  it  *■  tttu>  iA '>  i.Alli 
and  using<A.7)  ■*•  GTf(A  8)  -  (A  8)6'  -  (A  86  tf  and  6  f/i  A  s<  -  <  A  i>o  .uoi'  it  **>J  it  n't 

Similarly,  rTG( A.  10)T  -  (A  10)/’  -  (A  lo/V  >«ld»tsili 

Finally,  the  proof  can  be  fevered  %o  that  (8  5>  <*  l.'t  ixkJ  .A  1 .  <  A  ci  »nj  t '  *i  Scr  ju]  I..*  dneuls, 
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I  IhTBOtKCnOh 

As  is  aetl  iatswa  LQH  and  LQC  c  muted ict>  U.  l  guaranteed 
w*uttses»  wah  tesptvx  to artxtraty  pmmrtrr  sananoro  |l|.  |2|  Thus  tt 
n  wjt  wtpnupg  that  there  is  cmxsnierabte  tmerest  in  the  analysis  and 
tyathrsci  of  Itedhai  cnaaiuitrts  whuh  »te  robust  with  tevpeci  to 
structured  teal  nluoJ  plant  parameter  aaccnatws  The  present  ppprt  »  a> 
ttaats  sard  tn  pauaUt  bs  Use  fust ar* oed  cost  coeutot  approach  ot  Chang 
*****  |)|  |4)  and  the  t  durst  stability  icditiupK  csf  Petersen  and  Hollot 
(J|  |?|  (a  |>)  Chang  and  Rr*g  cmtssdrt  #  rt»»Jif«oJ  Rumti  equation 
artaste  tehrrtoftt  are  guaranteed  to  provide  hath  robust  stability  and 
performance  over  a  spec  ifird  range  of  parameter  sartatsoets  On  the  other 
hand  Reserve*  and  Hof  lot  mi  |5|.|?|  coftssdev  a  different  modified  Rtd.au 
equal  ly  uhtch  utilizer  a  quadrat*  Lyspunos  hound  to  prostdc  robust 
ttabtia)  over  a  range  of  structured  pfant  variations  in  the  present  paper, 
taa  combeac  aspects  of  both  of  (here  approaches  to  obtain  both  robust 
Kabday  and  performance 

Oar  preference  for  the  Reserve n- Hoik*  bound  over  the  bound  originally 
propound  by  Chang  and  Rrng  is  based  upon  the  fact  that  the  former  is 
dtffertauaHe  with  respect  to  the  Rnxau  sob* ton.  while  the  latter  it  not 
We  nptou  thus  smoothness  by  uuUnng  the  opumal  projection  approach 
fee  Aceid-ordeT  dynamic  compensation  |l)  tn  place  of  full-scale  feedback 
consadrrad  in  (J|.  fd|  |6|  (?|  A  systematic,  in -depth  treatment  of  the 
Chang- Peng  Reserve*- Hof  lot  and  other  bounds  (such  as  the  right  shift/ 
■nthipftrssive  white  aotse  bound  constdered  in  |9|-|ll]i  will  be  the 
mbyect  of  •  ftarure  paper  |I2| 

As  discussed  in  (81  the  optimal  projection  approach  to  ft  ted  order 
dynamic  compensation  is  based  upon  a  system  of  two  modified  algebraic 
Rsceali  equations  and  two  modified  algebras.  Lyapunov  equations  which 
directly  generalize  LOG  throes  to  the  case  of  reduced-order  controllers 
To  ensure  robust  stability  and  performance  for  reduced-order  controllers, 
the  present  paper  utilizes  the  Petersen- Hollot  quad  ran.  Lyapunov 
technique  to  bound  the  performance  of  controllers  of  fiu-J  dimension 
TV  performance  bound  i»  then  interpreted  av  the  cost  functional  for  an 
ou  rthort  mimmizenon  problem  whovc  optimality  condition*  diredly 
generalize  the  results  ol  (R1  Specifically,  we  again  obtain  a  coupled 
system  of  algebraic  Riccali  and  Lyapunos  equations  with  additional  terms 
arising  from  the  Petersen- Hollot  bound  When  uncertainty  is  absent, 
these  equations  specialize  immediately  to  the  result  of  |K|  which  m  turn, 
spec  allies  to  LQG  when  tV  compensate*  order  is  equal  to  the  plant 
dimension 

Although  the  optimal  projection  equations  are  necessary  conditions  for 
optimality .  it  is  important  to  stress  that  in  the  present  paper  they  are 
obtained  not  for  the  original  cost  function,  but  rathet  fin  a  bound  on  the 
ci>st  The  necessary  conditions  for  tV  auxiliary  minimization  problem 
ihus  effectively  serve  as  sufficient  conditions  for  the  original  problem 
Hence,  even  if  a  numerical  solution  of  the  extended  optimal  projection 
equations  fails  to  produce  the  globally  optimal  controller,  robust  stability 
and  performance  are  still  guaranteed  for  all  local  extremals  Our  approach 
thus  seeks  to  rectify  one  of  the  main  drawbacks  of  necessity  theory  by 
guaranteeing  both  robust  stability  and  performance  Nevertheless,  a 
numerical  algorithm  for  computing  the  global  optimum  is  given  in  (15) 

In  summary,  the  moin  contribution  of  the  present  paper  is  the 
generalization  of  the  optimal  projection  equations  by  means  of  the 
Petersen-Hollot  quadratic  Lyapunov  bound  to  synthesize  robustly 
stabilizing  fixed -order  dynamic  compensators  with  guaranteed  per¬ 
formance  bound,  it  is  interesting  to  note  that  even  in  the  full-order  case, 
our  results,  which  specialize  to  a  coupled  system  of  three  matrix 
equations,  are  distinct  from  the  results  of  (5|  which  involve  a  pair  of 
modified  Riccati  equations  and  an  auxiliary  inequality.  Furthermore,  the 
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present  paper  provides  a  robust  performance  bound  not  obtained  in  (5|- 
171  An  additional,  conceptual  benefit  of  our  approach  is  a  rigorous 
optimization  interpretation  for  the  Pete rsen-Ho) lot  Riccati  equation 
approach.  Finally,  as  shown  in  [20)  for  fall-state  feedback,  the  results 
given  herein  can  be  directly  applied  to  the  Hm  design  problem  For 
details,  see  (21). 

Due  to  space  constraints,  the  contents  of  the  paper  will  not  be  reviewed 
here.  We  note  only  that  the  proof  of  Theorem  8. 1 .  which  has  been  omitted 
for  this  reason,  can  be  found  in  113).  (14|  Finally,  although  numerical 
algorithms  are  outside  the  scope  of  this  note,  related  results  can  be  found 
in(I5| 

II.  Notation  and  Definitions 
Note:  All  matrices  have  real  entries 


noisy  measurements 

y</)-<C  +  AC)jr(/)+ w2(/).  (3.6) 

and  nfth-order  dynamic  compensator  (3.3),  (3.4),  the  performance 
criterion 

J(A„  B„  C,)  k  sup  lim  tup  £\xTil)R,x{t) 

lutiioev  ■-* 

+  2xr(t)f?,;U(t)  +  Ur(t)/fjU(/))  (3.7) 

is  minimized 

Remark  3.1:  Note  that  (3  7)  is  precisely  the  LQG  criterion  except  for 
the  su premum  over  'll  for  worst -case  performance 

For  each  controller  (A,,  B, .  C,)  and  plant  variation  (A/4.  AB,  AC)  € 
'll.  the  undisturbed  closed-loop  system  (31M3  4)  is  given  by 


«,  It’"'.  St'.  2. 

/,.  t  )r 
V)\  V 

2,  S  2;,  2,  <  Z; 

n,  m.  I,  n,;  n 
x,  u,  y,  x„  i 
A.  A/4;  B.  AB;  C.  AC 


At.  8,,  C, 

A.  A  A 


Real  numbers,  r  x  s  real  matrices. 
expected  value. 

r  x  r  identity  matrix,  transpose 

r  x  r  symmetric,  nonnegative-deftnite. 

positive-definite  matrices 

2:  -  2,  €  »Y.  22  -  2,  £  V.  2,.  Z. 

€  S'. 

Positive  integers;  n  +  n,. 

n,  m,  I,  nc,  /i -dimensional  vectors. 

n  x  n  matrices;  n  x  m  matrices:  /  x  n 

matrices 

n,  x  n,;  n,  x  /;  m  x  n,  matrices. 


\A 

BC,  "I 

[ax 

ABC,] 

L*c 

A,\’ 

[b,ac 

0  J 

/?|,  8) 


*,<  ).  »:(  ) 

y,.  y: 

V,: 


»■(  •).  y 

R 


n  x  n,  m  x  m  state.  control  weighting 

matrices.  B,  2  0.  Bj  >  0. 

n  x  m  cross  weighting  matrix;  B,  - 

B,;B.  'Bf,  2  0. 

rt.  /-dimensional  white  noise 

Intensity  of  H-,(-),  w:(-);  V,  2  0,  >  0. 

n  x  /cross  intensity  of  w,(  ).  w:(  ). 


[•».(  )  1  r  y, 

tR,  Rr.c.  1 
C'R '  CrB;C,  J 


y„B!  ‘ 
b  y.B' 


i{t)-{A  + lAuu).  I  €  |0.  «l.  (3.8) 

while  the  disturbed  closed-loop  system  (3.3)-(3.6)  is 

i(f)«<<4  +  A-4>i(f)+w(/>.  I  6  |0.  »).  (3  9) 

where  if!)  a  |jr r(/).  jrcr(/)| 7  and  w(  • )  is  while  noise  with  intensity  C  € 
W*. 


rv  Sufficient  Conditions  for  Robust  Stability  and 
Performance 

In  practice,  steady-state  performance  is  only  of  interest  when  the 
closed-loop  system  (3  8)  is  stable  over  11.  The  following  result  expresses 
the  performance  in  terms  of  the  steady-state  closed-loop  second-moment 
matrix. 

Lemma  4. 1:  Suppose  (3  8)  is  stable  for  all  (A/4.  AB,  AC)  6  'll  Then 
J(A„  Bc.  C,)«  sup  t (4.1) 

where  k  lim,_»  £[.f(/)jr r(/)J  6  is  the  unique  solution  to 

0»(/i  +  A/4H?iT  +  (?s/((^  +  A/4)r+  f>.  (4.2) 

We  now  seek  upper  bounds  for  J(A, ,  B. .  Cr). 

Theorem  4.1:  Let  1):  iT"  x  It"''7  x  —  5"  be  such  that 

AXq+qAX'slNQ.,  B„  C,). 

(A/4 ,  AB.  AC)  £  'll.  (Cl,  B,.  C)  6  iTxjf.  "x  if”.,  (4.3) 


III  Robust  Stability  and  Robust  Performance  Problems 

Let  'll  C  It"’"'  x  ft*""  x  SI”"  denote  the  set  of  uncertain 
perturbations  (A.4 .  AB.  AC)  of  the  nominal  plant  matrices  A ,  B,  and  C 
Robust  Stability  Problem:  For  fixed  rt,  s  n,  determine  (-4,  ,  B, ,  C, ) 
such  that  the  closed-loop  system  consisting  of  the  nth-order  controlled 
plant 

•»’(/)  =  (/4  +  A/4  )jr(/)  +  (B *  AB)u(i),  /£((),«),  (3.1) 

measurements 

y(0  =  (C+  AC)jr(l),  (3.2) 

and  nrt^| -order  dynamic  compensator 

jr,(r)  =  X,jr,<f)  +  B,.>'(f).  (3.3) 

ir(r)  =  C,jr,(/)  (3.4) 

is  asymptotically  stable  for  all  (AX,  AB,  AC)  €  Tl. 

Robust  Performance  Problem:  For  fixed  nf  s  n,  determine  (X,,  B, . 
C, )  such  that,  for  the  closed-loop  system  consisting  of  the  nth-order 
disturbed  plant 

jr(/)»(X  +  A/4  )jr</)  ♦  (fl+  AB)u(/)+  w,(f).  r  €  |0,  »),  (3.5) 


and,  for  given  ( A ,,  B, ,  C,),  suppose  there  exists  Q.  6  /“i"  satisfying 

0  =  XCJ,+  Q,4 '  +  fl(Q.,  B. ,  C, )  +  P,  (4.4) 

and  suppose  the  pair  (P1  A  +  AX)  is  stabilizablc  for  all  (A/4.  AB. 
AC)  6  'll.  Then  A  +  A/4  is  asymptotically  stable  for  all  (A/4,  AB.  AC) 
€  'll, 

&i<q,  (AX.  AB,  AC)  6  It.  (4.5) 

where  (Jj  satisfies  (4.2).  and 

/(X„  fl„  C,)Str  q/f.  (4.6) 

Proof:  For  all  (A/4,  AB,  AC)  €  'll.  (4.4)  is  equivalent  to 

0=</4  +  A/J)Q,+  «l(/f  +  A/f)r-f  +(0..  B„  C„  AX*)  +  P,  (4.7) 

where 

♦  (Cl,  B„  C„  A/?)  »  fl(d.  fl„  C,)-(A^q+qA/4r). 

Note  that  by  (4.3),  ♦(q.  B„  Cr.  A/4)  2  0  for  all  (AX,  AB,  AC)  €  'll 
Since  (P,J.  ,4  +  A/4)  is  stabilizable  for  all  (AX,  AB,  AC)  £  Tl.  it 
follows  from  [16,  Theorem  3.6)  that  (( P  +  ♦(Q,  B„  Cf,  A A))'n,  A  + 
A/4)  is  stabilizable  for  all  (AX,  AB,  AC)  £  Tl.  Hence.  [16.  Lemma 
12.2)  implies  A  +  AX  is  asymptotically  stable  for  all  (AX,  AB,  AC)  £ 


580 

11.  Next,  subtracting  (4.2)  from  44.7)  yields 


IEEE  TRANSACTIONS  ON  AUTOMATIC  CONTROL.  VOL  33.  NO  6.  JUNE  IMS 
vil.  The  Auxiliary  Minimization  problem 


0-(/J  +  A/iXft-&,t)-Mft-(?.>/iX/<  +  A/*)r++<ft.  Be.  c„  &A) 
or.  equivalently  (since  A  +  aA  is  asymptotically  stable), 

ft-&t-  {’  B„  Cn  AA)ttA'*A,T' di* 0. 

J0 

which  implies  (4.5).  Finally.  (4.5)  and  (4.1)  yield  (4.6).  □ 

V.  uncertainty  Structure 

To  obtain  explicit  expressions  for  ( Ae ,  B„  Cr),  we  require  that  Afl  = 
0,  (A/4,  AB,  AC)  G  11.  Hence,  for  simplicity,  we  write  (A/4,  AC)  G 
*U .  The  dual  case  AB  *  0  and  AC  *=  0  is  treated  in  Section  X.  Thus,  'll  is 
assumed  to  be  of  the  form 

11 »  j^A/4.  AC)  6  }C*"x  11“’  :  AA  *  DM.N.E,. 

AC=£  F.M.N.E,.  M,M,rsM,.N,rN,stt,.i«l.'-,pj  ,  (5.1) 


To  optimize  robust  performance  while  guaranteeing  robust  stability,  we 
consider  the  following  problem. 

Auxiliary  Minimization  Problem:  Determine  (ft,  Ar,  B<,  Cc)  which 


minimizes 

3(ft.  A„  B,.  C,)  £  tr  ftA 

(7.1) 

subject  to 

ft  G  fl". 

(7.2) 

o=/fft+ft/fr+2  ( OM A,r i- ftA'/v, Aft) «-  F. 

tm  | 

(7.3) 

(F'  A  +  A/f)  is  stabilizable,  (A/4,  AC)  €  It. 

(7.4) 

Proposition  7.1:  If  (ft.  A,,  B, .  Cr)  satisfies  (7.2)-(7.4j.  then  A  + 
A/4  is  asymptotically  stable  for  all  (A/4,  AC)  G  1i  and 


HAe.  B,,C,)s3(ft.  -4r.  B„  Cr).  (7.5) 

Proof:  With  0  given  by  (6.1).  the  hypotheses  of  Theorem  4.1  are 
satisfied  so  that  robust  stability  is  guaranteed  with  performance  bound 
(4.6).  □ 


where,  for  t  =  I,  •  •  •,  p:  A  €  11”':,  E,  G  Ift'i*",  and  Ft  G  J !'*'«  are 
fixed  matrices  denoting  the  structure  of  the  uncertainty  ;  A?,  G  M'<  and  i V, 
G  ii'i  are  given  uncertainty  bounds;  and  M,  G  Jl'i*1*  and  N,  G  )l,'y'>  are 
uncertain  matrices.  The  closed-loop  system  thus  has  structured  uncer¬ 
tainty  of  the  form 

p 

A  A  *  2 

•  •I 

where 

["«]•*  * « oi 

The  special  case  M,  =  p ;/,,,  N,  =  ►?/,,  is  worth  noting. 

Proposition  5.  I:  Let  p ,,  r,  z  0,  i  =  1 ,  ■  •  ■ ,  p.  Then  M,MJ  s  pfL, 
and  S'N,  s  v‘l,,  if  and  only  if  o^.fAf,)  £  p,  and  <w(N,)  £ 

Remark  5.1:  The  form  of  11  given  by  (5.1)  is  directly  related  to  the 
structured  stability  radius  introduced  by  Hinrichsen  and  Pritchard  jl7j, 
[18|.  Specifically,  let  p  =  1,  Af,  =  pth,,  r,  *  and  /V,  ■  (V,  =  /,,. 

VI.  The  Petersen-Hollot  Bound 

Given  11.  wc  now  specify  the  bound  0  satisfying  (4.3).  Note  that 
because  of  Afl  =  0, 1)  is  independent  of  C, .  Hence,  we  write  tl(ft,  Br)  for 
Q(ft.  fl..  Cr). 

Proposition  6.1:  The  function 


vm.  Necessary  CoNDmoNs  for  the  auxiliary  minimization 
Problem 

Rigorous  derivation  of  the  necessary  conditions  for  the  Auxiliary- 
Minimization  Problem  requires  additional  technical  assumptions.  Specifi¬ 
cally,  in  addition  to  (7.2),  we  restrict  (ft,  Ac,  Bc,  Cc)  to  the  open  set 

8  £  {(ft,  A„  Bt.  Cr)  :  ft  6  J»\  fl  is  asymptotically  stable. 

and  (/4„  B„  Cr)  is  controllable  and  observable), 

where  (see  |  19)  for  the  definition  of  the  Kroneckcr  sum) 

a  *  ('i+S  ®  (a- t-^ft^N/, 

Furthermore,  the  constraint  (7.4)  will  not  be  accounted  for  explicitly  since 
it  can  be  shown  that  the  compactness  of  11  implies  that  the  set  of  ( Ac .  A,, 
Cr)  satisfying  (7.4)  is  open. 

Remark  8.1:  The  constraint  (ft,  Ac.  Bc,  Cc)  G  S  is  not  required  for 
either  robust  stability  or  robust  performance  since  Proposition  7. 1  shows 
that  only  (7.2M7.4)  are  needed  Rather,  the  set  S  constitutes  sufficient 
conditions  under  which  the  Lagrange  multiplier  technique  is  applicable  to 
the  Auxiliary  Minimization  Problem.  Specifically,  the  condition  ft  >  0 
replaces  (7.2)  by  an  open  set  constraint,  (he  stability  of  5  serves  as  a 
normality  condition,  and  ( Ac ,  flc,  Cr)  minimal  is  a  nondegeneracy 
condition. 

For  arbitrary  Q,  P  G  It" ' ’  define  the  following  notation: 


(1(0.,  fl,)  i  J  A A7,i5(r+ft£,rN,£,ft 


(61) 


D  u  £  AM,D,r.  E  fc  J  £rK£  - 


sausfies  (4.3)  with  H  given  by  (5.1). 

Proof:  For  i  =  1 ,  •  •  • ,  p. 

Os  1 AM,  -  ftA,r/V/-j[AM,  -  dEjNj) T 
-  AM,M,rAr+ ft£f/vfjv,A,ft-  {D,m.n£,Q.+ ekEJNJMjOj) 
s  AM,A,r+ ftA,rtf, Aft  -  (Am, n, Aft + ftA;  njm;0[). 

Summing  over  /  yields  (4.3).  >  □ 

Remark  6.1:  The  bound  (6.1)  was  originally  proposed  by  Petersen  in 
{5}  for  unit-rank  perturbations  with  scalar  uncertain  parameters.  A  more 
general  treatment  appears  in  (7).  Note  that  we  absorb  the  epsilon  used  in 
(71  into  A  and  E,. 


P.  k  BTP+  RJiV  Q.  it  QCT  +  V,2  +  J  D,M,FJ , 

Ap  A  A  -BRj'P,,  A0  A  A-Q.y;JC,  Vu  £  Ftf.FJ. 

«•  I 

The  following  factorization  lemma  is  needed.  For  details,  tec  (8). 
Lemma  8. 1:  If  Q.  P  G  M"  and  rank  QP  «  n,,  then  there  exist  nc  x  n 
C,  T.  and  nr  x  nr  invertible  M  such  that 

QP-GTMT,  (8.1) 

r  Gr-/V  (8.2) 
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Furthermore,  G,  M,  knd  T  are  unique  except  for  a  change  of  basis  in  7iV 
As  shown  in  [8],  the  matrix  r  defined  by 

r  4  QP(QP)'  =  GTT  (8.3) 

is  an  oblique  projection  where  ( )'  denotes  group  generalized  inverse  [8]. 
For  convenience,  define  the  complementary  projection  rx  4  l,  -  r. 

Theorem  8.1:  If  (Q.,  Ac,  Bc,  Cc)  £  8  solves  the  Auxiliary 
Minimization  Problem  with  *U  given  by  (5.1),  then  there  exist  Q,  P,  (J,  P 
€  M"  such  that 


A,  =  T(A  -BR;'P.~ Q. P2",‘c+  QE)G\  (8.5) 

(8.6) 

C,-  -R;'P,GT,  (8.7) 

and  such  that  Q,  P,  Q.  P  satisfy 

\ 

0  *‘AQ  +  QAT+V,  +  D+QEQ-Q.Vu'q;+t1Q.V-Jq;tT±.  (8.8) 

0=lA  +  (Q+  $)E]  tP+  PIA  +(Q+  (J)£] 

+  *i  - P4rR2- '/>.+  t[p;R; 'P.t,,  (8.9) 

o  =  (A,+  0£><?  +  G(A,+  Q£)r+  QEC  +  Q.V^Qt-ri  Q.V  jQlr\. 

(8.10) 

0  =  (Aff+0£),'/s+/i(A<?  +  <3£)  +  />:«J-1P.-r^P;flJ-'P.ri,  (8.11) 

rank  $  =  rank  /*=  rink  QP*>nc.  (8.12) 

Furthermore,  the  auxiliary  cost  is  given  by 

A„  B„  Cr)  =  tr  l(0  +  0)R,  +  <>PBR2  'P,-R12R2  ‘/>.<5j.  (8.13) 

Conversely,  if  there  exist  Q,  P,  P  €  PI"  satisfying  (8.8)— (8. 12).  then 
(Q..  Ac,  Br,  Cc)  given  by  (8.4)-(8.7)  satisfy  (7.2)  and  (7.3)  with  cost 
(8.13). 

Proof:  See  |13],  (14)  □ 

Remark  8.2 :  Theorem  8. 1  presents  necessary  conditions  for  the 

Auxiliary  Minimization  Problem  which  explicitly  characterize  extremal 
quadruples  (Q,,  Ac,  Br.  C0).  These  necessary  conditions  consist  of  a 
system  of  two  modified  Riccati  equations  and  two  modified  Lyapunov 
equations  coupled  by  both  the  optimal  projection  r  and  uncertainty  terms. 
Several  special  cases  can  immediately  be  discerned.  For  example,  in  the 
full-order  case  nc  =  n.  set  r  =  /„  so  that  ri  =  0.  Now  the  last  term  in 
each  of  (8.8M8.1I)  can  be  deleted  and  G  and  T  in  (8.5)-(8.7)  can  be 
taken  to  bc  the  identity.  Furthermore.  P  plays  no  role  so'thai  (8.11)  is 
superfluous.  Note  that  in  this  case,  (8.8)  is  independent  of  P  and  Q 
Setting  further  D,.  £,,  and  F,  to  zero,  it  can  be  seen  that  (8.10)  and  (8.11) 
drop  out,  while  (8.8)  and  (8.9)  reduce  to  the  standard  separated  Riccati 
equations  of  LQG  theory .  If,  alternatively .  the  reduced-order  constraint  is 
retained,  but  the  uncertainty  terms  are  deleted,  then  the  results  of  |8}  are 
recovered. 

Remark  8.3:  When  solving  (8.8)-(8.12)  numerically,  the  uncertainty 
terms  can  be  adjusted  to  examine  tradeoffs  between  performance  and 
robustness.  Specifically,  the  bounds  M,  and  N,  and  structure  matrices  D„ 
E„  and  Ft  appearing  in  Q„  D,  E,  and  V u  can  be  varied  systematically  to 
determine  the  region  of  solvability  of  (8.8)-(8.12). 

DC.  Sufficient  Conditions  for  Robust  stability  and 
Performance 

Theorem  9.1:  Suppose  there  exist  Q,  P,  Q,  P  €  W"  satisfying  (8.8)- 
(8. 12),  and  assume  that  ( P'n,  A  +  AA)  is  stabilizable  for  all  (AA,  AC) 
€  *U  with  At,  Bc,  Cf  given  by  (8.5)-(8.7)and  *U  given  by  (5.1).  Then  A 
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+  &A  is  asymptotically  stable  for  all  (AA ,  AC)  €  'll  and  the  closed-loop 
performance  is  bounded  by  (8.13). 

Proof:  Theorem  8. 1  implies  that  Q.  given  by  (8.4)  satisfies  (7.2)  and 
(7.3).  With  the  stabilizability  assumption,  the  result  follows  from 
Proposition  7.1.  G 

X.  The  Dual  Case 

In  place  of  (5.1),  assume  now  that  AC  «  0,  (AA,  AB,  AC)  £  'll,  and 
define 

Tl=  ^(AA,  AB)  6  «***x|i*—  :  AA  =  £  D.M.N.E,, 

Afl  =  £  D,M,N,G„  M.M'sM,,  /V^iV.sjV,,  /.  I ,  ,  p  j  .  (10.1) 

where, fori  =  1,  6  and  G,  £  are 

fixed  matrices  denoting  the  structure  of  the  uncertainly:  and  M  ,  M,, 

and  N,  are  as  before.  For  arbitrary  Q,  P  €  Jl""  define  the  following 
notation: 

P,  4  BTP+Rl1+'£  GJN,E„  Q.  4  QCr+  V,i, 

I-  I 

A,  4  A-BR  ’JP.,  A0  4  A-Q.v;'c.  Rj.  4  Rj+£  Gftf.G,. 

im  I 

The  main  result  guaranteeing  robust  stability  and  performance  for  the 
dual  problem  can  now  be  stated.  For  details,  see  [13],  |14}. 

Theorem  10. 1:  Suppose  there  exist  P,  Q.P.Q  C.  JJ"  satisfying  (8.12) 
and 

0’*ATP+PA  +Ri  +  £+  PDP-P\R  j,'  P.+  t\  PTmR  P.r, ,  (10.2) 
0  =  (A+D(P  +  P)\Q  +  Q[A+D(P+P))r 

+  V,  ~  Q.  V,  ' r .  Q.v; 1 0T.rl ,  (10.3) 

o = (  a  Q + dp) tp + p(  A  v + dp) + pdp + p;r  Jp.-t  \p\r  -j  P.j  . . 

(10.4) 

0  =  (A,  +  DP)C+  QlAr*  DP)T+Q.  v;  ’  (5J-  r.  &  l*’j  1  (10.5) 

and  assume  that  (ft'  \  A  +  AA)  is  detectable  for  all  (AA,  AB)  £  *U 
with  Ar,  B,,  Cr  given  by 


=  r<A  -  0,  V- 1 C-  BR  J  P,  +  DP)GT, 

(10.6) 

B^rQ.v:'. 

(10.7) 

Cf=  -*2>,Gr, 

(10.8) 

and  'll  given  by  (10.1).  Then,  with  (10.6W10.8).  A  +  A  A  is 
asymptotically  stable  for  all  (AA,  AB)  €  'll  and  the  performance  of  the 
closed-loop  system  satisfies 

J(A„  Br.  C,)str  [(P  +  P)V{  +  Q.v;'CQP-PQ'Vl  V')  (10.9) 

Remark  10.1 :  Even  in  the  case  AB  «  0,  AC  «  0,  the  performance 
bounds  (8. 13)  and  (10.9)  are  generally  different. 

Remark  10.2:  The  case  in  which  AB  and  AC  are  simultaneously 
nonzero  also  appears  to  be  tractable  and  leads  to  additional  terms  in  the 
design  equations.  The  bound  considered  in  (M)  also  permits  this  case. 

References 


(!)  J.  C.  Doyle.  “Ouanmeed  martin  tor  LOG  refulaion,"  IEEE  7>wu.  Aylomyt. 
Contr. ,  vol.  AC-23,  pp.  756-757.  1978 


rnmmmmmmmmmmrnmimmmmmmmmmmmmm 


(2)  E.  Soroki  and  U.  Shxked.  "On  the  robustness  of  LQ  regulators,"  IEEE  Trans. 
Automat.  Contr.,  vol.  AC-29,  pp.  664-665,  1984. 

(31  S.  S.  L  Chang  and  T.  K  C.  Peng,  “Adaptive  guaranteed  coat  control  of  systems 
with  uncertain  parameters,"  IF.EE  Trans.  Automat.  Contr.,  vol.  AC-12,  pp. 
474-483.  1972. 

(4)  A.  VinLler  and  L.  J.  Wood.  “MuJtistep  guaranteed  cost  control  of  linear  systems 
with  uncertain  parameters,"  J.  Guidance  Contr.,  vol.  2,  pp.  449-456.  1979. 

|S)  I.  R  Petersen,  "A  Riccati  equation  approach  to  the  design  of  stabilizing 
controllers  and  observers  for  a  class  of  uncertain  linear  systems."  in  Proc.  Amer. 
Contr.  Con/..  Boston.  MA,  June  1985.  pp  772-777. 

|6|  I.  R.  Petersen  and  C.  V.  Holloc.  "A  Riccati  equation  approach  to  the  stabilization 
of  uncertain  systems."  Automatica,  vol.  22.  pp.  397-411.  1986. 

(7|  1.  R.  Petersen.  "A  stabilization  algorithm  for  a  class  of  uncertain  linear  systems." 
Syst.  Contr.  Let:.,  vol.  8.  pp.  351-357.  1987. 

(8|  D.  C.  Hyland  and  O.  S.  Bernstein.  "The  optimal  projection  equations  for  fixed- 
order  dvnamic  compensation.”  IEEE  Trans.  Automat.  Contr.,  vol.  AC -29.  pp 
1034-1037.  1984 

|9J  D  S  Bernstein  and  S.  W.  Greeley.  "Robust  controller  synthesis  using  the 
maximum  entropy  design  equations."  IEEE  Trans.  Automat.  Contr.,  vol.  AC- 
31.  pp.  362-36S.  1986 

|I0|  - .  "Robust  output-feedback  stabilization:  Deterministic  and  stochastic  per¬ 

spectives."  in  Proc.  Amtr.  Contr.  Con/..  Seattle.  WA,  June  1986.  pp  1818- 
1826 

(III  D  S  Bernstein.  “Robust  static  and  dynamic  output  feedback  stabilization: 
Deterministic  and  stochastic  perspectives."  IEEE  Trans.  Automat.  Contr..  vol 
AC-32,  pp  1076-1084.  1987, 

|I2|  D  S.  Bernstein  and  W.  M  Haddad.  "Robust  stability  and  performance  of  linear 
dynamic  systems  via  a  priori  quadratic  Lyapunov  bounds."  in  preparation 

|I3|  W.  M  Haddad.  "Robust  optimal  projection  control-system  synthesis."  Ph  D. 
dissertation.  Dep  Mcch.  Eng  .  Florida  Inst.  Techno!.,  Melbourne,  FL,  Mar. 
1987 

|I4|  D.  S.  Bernstein  and  W.  M.  Haddad.  "The  optimal  projection  equations  with 
Petersen-HoHm  bounds:  Robust  controller  synthesis  with  guaranteed  structured 
stability  radius."  in  Proc.  IEEE  Con/.  Decision  Contr.,  Lot  Angeles.  CA.  Dec. 
1987.  ^sp  1308-1318. 

(IS]  5  Richter.  "A  homotopy  algorithm  for  solving  the  optimal  projection  equations 
for  fixed-order  dynamic  compensation:  Existence,  convergence  and  global 
optimalitv."  in  Proc.  Amer.  Contr.  Con/..  Minneapolis.  MN.  June  1987,  pp. 
1527-1531. 

|I6]  W.  M.  Wonham.  Linear  Multivariable  Control:  A  Geometric  Approach. 
New  York  Springer-Verlag.  1979. 

(171  D  Hinnchsen  and  A.  J  Pntchard.  "Stability  radii  of  linear  systems,"  Syst. 
Contr.  Lett.,  vol.  7.  pp  1-10.  1986. 

(IS)  D  Hinnchsen  and  A  J.  Pnichard.  "Stability  radius  for  structured  perturbations 
and  the  algebraic  Riccati  equation."  Syst.  Contr.  Lett.,  vol.  8.  pp.  105-113, 
1987 

)19|  J  W.  Brewer.  “Kronecker  products  and  matrix  calculus  in  system  theory  ."  IEEE 
Trans  Circuits  Syst..  vol  CAS-25.  pp  772-781.  1978. 

|20|  1  R  Petersen.  "Disturbance  attenuation  and  Hm  optimization:  A  design  method 
based  on  the  algebraic  Riccati  equation."  IEEE  Trans.  Automat.  Contr.,  vol. 
AC-32,  pp  427-429.  1987 

(2 1 1  C.  S.  Bernstein  and  W.  M.  Haddad.  "LQG  control  with  an  Hm  performance 
bound."  Amcr.  Contr.  Con/.,  June  1988.  Atlanta.  GA. 


A  Frequency  Response-Based  Model  Order  Selection 
Criterion 
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Abstract — The  use  of  weighting  sequence  models  to  describe  the 
dynamics  of  physical  systems  provides  an  effective  means  of  translating 
(he  uncertainty  associated  with  the  model  parameter  estimates  derived 
from  noisy  inpul/output  data  into  corresponding  frequency  response 
uncertainty  information.  However,  an  appropriate  truncation  level  must 
be  established  to  accomplish  this  task.  This  paper  addresses  the  trunca¬ 
tion  problem  from  a  frequency  response  perspective  and  proposes  a  new 
criterion  baaed  on  frequency  response  considerations  to  select  the  proper 
truncation. 
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I.  INTRODUCTION 

Recent  work  on  robustness  analysis  methods  for  multivariable  systems 
has  led  to  the  development  of  structured  singular  value  techniques  (e.g.. 
[1],  (21)  which  provide  a  means  of  assessing  the  impact  of  system 
uncertainty  on  closed-loop  stability  and  performance.  A  key  missing 
element  in  these  analysis  methods  is  the  ability  to  describe  the  frequency 
response  uncertainty  associated  with  any  given  system.  When  system 
identification  techniques  are  used  to  derive  the  system  description, 
however,  it  becomes  possible  to  quantify  system  uncertainty  statistically, 
and  recent  efforts  have  demonstrated  that  uncertainty  information  on  the 
estimated  parameters  of  the  system  model  can  be  transformed  into 
corresponding  information  on  the  frequency  response  uncertainty  of  the 
system  |3).  (4).  For  difference  equation  models,  the  transformation  from 
the  parameter  space  to  the  frequency  domain  is  nonlinear,  a  result  which 
necessitates  the  use  of  linear  approximations  and  produces  a  statistical 
description  of  uncertainty  that  fails  to  account  for  the  interfrequency 
dependence  of  the  frequency  response  estimates.  On  the  other  hand. 
Cloud  and  Kouvaritakis  [4]  have  shown  that  these  problems  can  be 
avoided  by  the  use  of  weighting  sequence  models  to  describe  system 
dynamics. 

The  uncertainty  description  developed  in  [4]  assumes  that  the  system 
can  be  accurately  described  by  a  finite  weighting  sequence  model,  an 
assumption  that  is  valid  for  all  stable  systems.  This  assumption,  in  turn, 
implies  that  the  “correct"  model  order  (i.e.,  truncation  level)  is  known. 
As  a  result,  the  identification  process  must  not  only  be  able  to  generate 
appropriate  parameter  estimates,  it  must  also  be  able  to  identify  the 
“correct"  level  of  truncation.  In  effect,  this  second  requirement  is  a 
restatement  of  the  standard  model  order  selection  problem,  a  problem 
which  has  been  widely  investigated  in  the  literature  (e.g..  [5]).  But  for  the 
frequency  response  applications  of  interest  here,  appropriate  solutions 
must  focus  on  generating  accurate  frequency  response  information.  When 
this  perspective  is  taken,  it  becomes  clear  that  the  standard  order  selection 
criteria  are  not  well  suited  to  the  task  because  they  focus  on  generating 
accurate  input/output  descriptions  rather  than  accurate  frequency  re¬ 
sponse  descriptions. 

In  this  paper,  a  new  criterion  is  derived  to  identify  the  "correct" 
truncation  level  based  on  frequency  response  considerations.  The 
development  begins  by  highlighting  a  geometric  interpretation  of  the 
standard  “input/output"  order  selection  problem.  These  geometric  results 
are  then  transformed  into  the  frequency  domain  to  produce  the  new 
"frequency  response-based"  criterion  for  truncation  selection,  and 
simulation  results  are  presented  to  demonstrate  its  use.  Armed  with  the 
"correci"  truncation  level  generated  by  this  criterion,  it  is  now  possible 
to  implement  the  techniques  described  in  |4)  to  produce  a  valid  description 
of  frequency  response  uncertainty  for  any  given  system. 

11.  Model  Order  Selection:  a  Geometric  Perspective 

Consider  the  discreic-timc  system  with  weighting  sequence  elements 
{9i,  8:,  9),  •  •  ■ }  whose  true  response  at  sample  k  to  the  set  of  inputs  {u(k 
-  1),  u(k  -  2),  •  •  -  ,  u(0))  is  given  by 


y°U)  =  j  »,u(k-i)  =  d't0o 


where  $°  =  |9,  ■  •  •  9,)'  and  d\  -  |u(Ar  -  1)  •  •  •  u(0)J  The  measured 
output  at  sample  k  is  then  given  by 

y"(*)»y°(*)  +  t(*)  (2) 

where  t(k)  is  assumed  to  be  an  element  of  a  white  noise  sequence  with 
variance  oj.  For  a  set  of  A/  measurements,  we  may  stack  the  seal  an  ym(k) 
and  e(k)  as  elements  of  the  vectors  ym  and  t,  respectively,  and  may  then 
rewrite  (2)  as 

y-.y  +  e-DOfo+t  (3) 

where  the  rows  of  D°  are  given  by  the  vectors  d’t  for  k  •  1 ,  ■  ■  • ,  N. 
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Fixed-Order  Dynamic  Compensation 
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Abstract 

Two  robust  control-design  problems  are  considered.  The  Robust  Stabilization  Problem  in¬ 
volves  deterministically  modeled  bounded  but  unknown  time-varying  parameter  variations,  while 
the  Robust  Performance  Problem  includes,  in  addition,  a  quadratic  performance  criterion  averaged 
over  stochastic  disturbances  and  maximized  over  the  admissible  parameter  variations.  For  both 
problems  the  design  goal  is  a  fixed-order  (i.e.,  reduced-  or  full-order)  dynamic  (strictly  proper) 
feedback  compensator.  A  sufficient  condition  for  solving  the  Robust  Stabilization  Problem  is  given 
by  means  of  a  quadratic  Lyapunov  function  parameterized  by  the  compensator  gains.  For  the 
Robust  Performance  Problem  the  Lyapunov  function  provides  an  upper  bound  for  the  closed- 
loop  performance.  This  leads  to  consideration  of  the  Auxiliary  Minimization  Problem:  Minimize 
the  performance  bound  over  the  class  of  fixed-order  controllers  subject  to  the  Lyapunov-function 
constraint.  Necessary  conditions  for  optimality  in  the  auxiliary  problem  thus  serve  as  sufficient 
conditions  for  robust  stability  and  performance  in  the  original  problem.  Two  particular  bounds 
are  considered  for  constructing  the  quadratic  Lyapunov  function.  The  first  corresponds  to  a  right 
shift/multiplicative  white  noise  model,  while  the  second  was  suggested  by  recent  work  of  Petersen 
and  Hollot.  The  main  result  is  an  extended  version  of  the  optimal  projection  equations  for  fixed- 
order  dynamic  compensation  whose  solutions  are  guaranteed  to  provide  both  robust  stability  and 
robust  performance. 


This  research  was  supported  in  part  by  the  Air  Force  Office  of  Scientific  Research  under 
contract  F49620-86-C-0002. 


Although  considerable  effort  has  been  devoted  to  frequency-domain  robust  control-design  meth¬ 
ods  ([1-10]),  there  remain  open  questions  concerning  stability  with  respect  to  real- valued,  structured 
plant  parameter  variations  ([11-13]).  Specifically,  it  is  shown  in  [11-13]  that  classical  gain  and  phase 
margin  specifications  can  be  satisfied  while  sensitivity  to  structured  plant  parameter  variations  can 
be  arbitrarily  large.  From  a  time-domain  point  of  view,  the  parametric  robustness  problem  has 
been  widely  studied  using  Lyapunov’s  second  method  as  the  principal  technique  ([14-28]). 

In  the  present  paper  we  develop  an  approach  to  control  design  which  provides  sufficient  condi¬ 
tions  for  robust  stability  and  performance  over  a  prescribed  range  of  time-varying  structured  plant 
parameter  variations  by  means  of  a  feedback  law  in  the  form  of  a  fixed-order  (i.e.,  reduced-  or 
full-order)  dynamic  (strictly  proper)  compensator.  The  approach  is  based  upon  the  merging  of  two 
techniques,  namely,  the  guaranteed  cost  control  approach  to  robust  performance  ([14,17])  and  the 
optimal  projection  approach  to  quadratically  optimal  fixed-order  dynamic  compensation  ([29,30]). 
One  of  our  goals  is  to  obtain  robust  output-feedback  compensators  rather  than  full-state-feedback 
controllers.  Also,  since  we  wish  to  account  for  real-time  computational  burden  in  implementing  the 
controller,  we  impose  a  constraint  on  the  dimension  (i.e.,  order)  of  the  dynamic  compensator.  This 
approach  thus  generalizes  standard  LQG  theory  which  yields  full-order  output-feedback  controllers 
for  systems  without  parameter  uncertainty.  We  note  that  our  approach  is  constructive  in  the  sense 
that  upon  satisfaction  of  the  sufficient  conditions,  the  feedback  gains  required  for  implementing  the 
robust  feedback  controller  are  explicitly  synthesized.  Existential  issues  are  also  addressed  herein, 
although  to  a  lesser  extent.  For  further  background,  see  [29,30].  For  extensions  to  nonstrictly 
proper  controllers  see  [31]  and  for  extensions  to  Hoo  control  see  [32]. 

To  explain  the  rationale  behind  the  development  we  briefly  describe  the  main  elements  of  the 
approach-  The  following  discussion  is  intended  to  be  descriptive;  precise  conditions  appear  in  the 
main  body  of  the  paper. 

1.  Robust  Stability  Problem.  For  a  nominal  linear  time-invariant  (A,B,C)  system  we  consider 
deterministically  modeled  bounded  but  otherwise  unknown  Lebesgue  measurable  time-varying  pa¬ 
rameter  variations  of  the  form 

p  p  p 

A  +  '*Tai(t)Ai,  B  +  C  +  ^<7t(t)C,.  (LI) 

»=i  »=i  «=i 

The  nominal  matrices  A,  B,  C  and  the  perturbation  matrices  A,,  denoting  the  structure  of 


the  parametric  uncertainty  are  assumed  known,  while  the  time- varying  uncertain  parameters  &,(t) 
are  assumed  only  to  satisfy  the  bounds 


I  |<  £,  i  =  l,...,p,  t  G  [0, oo). 


(1.2) 


The  form  of  (1.1)  permits  an  arbitrary  number  of  uncertain  parameters  with  arbitrary  linear  struc¬ 
ture.  Although  we  do  not  require  matching  conditions  as  in  [21],  the  linear  structure  of  (1.1)  is  more 
restrictive  than  the  functional  form  A{q(t))  used  in  [21].  It  is  this  structure  which  we  exploit  to 
obtain  sufficiency  conditions.  Note  also  that  the  representation  (1.1)  is  independent  of  state  space 
basis  since  replacing  A  by  SAS~l  corresponds  to  replacing  A<  by  SA<S-X.  As  will  be  seen,  our 
robustness  bounds  and  optimality  conditions  are  also  basis  independent.  Also,  scaling  techniques 
([6,7])  will  not  play  a  role  here.  Finally,  we  note  that  because  of  the  time-varying  nature  of  the 
uncertain  perturbations  (1.1)  it  is  virtually  impossible  to  determine  the  actual  stability  region  of  a 
given  design  by  means  of  empirical  methods. 


2.  Quadratic  Lvapunov  Function.  As  a  sufficient  condition  for  characterizing  solutions  of  the 
Robust  Stability  Problem  we  consider  a  closed- loop  quadratic  Lyapunov  function  V(i)  =  xTPx, 
where  the  matrix  P  satisfies 

0  =  ATP  +  PA  +  Cl(P,Be,Ce)  (1.3) 


and  the  function  Cl  is  a  bound  satisfying 

p 

1 

is si 

over  the  parameter  range 


+  PAi)  <  Cl(P,Be,Ce) 


t  =  l,...,p. 


(1.4) 


(1.5) 


Note  that  the  constant  a » in  (1.4)  and  (1.5)  plays  the  role  of  &i(t),  i.e.,  t  is  “frozen”  in  (1.4)  and  (1.5). 
In  (1.3)  and  (1.4)  A  and  A*  denote  the  closed-loop  dynamics  and  closed-loop  parameter-uncertainty 
matrices  given  by 


A  = 


A 

BCc  1 

A  •  == 

Ai 

BiCc 

BeC 

Ac  j 

i  — 

BeCi 

0 

(1.6) 


Since  A,  is  independent  of  Ae,  Cl  depends  only  on  Be  and  Ce.  As  discussed  later  in  this  section, 
(1.4)  is  automatically  satisfied  by  construction  of  the  function  fl.  Furthermore,  the  existence  of  a 
solution  P  to  (1.3)  need  not  be  verified  directly  but  is  rather  a  result  of  numerically  solving  the 
optimality  conditions  discussed  below. 
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3.  Robust  Performance  Problem.  In  addition  to  the  deterministic  parameter  uncertainty  model 
(1.1),  (1.2),  the  Robust  Performance  Problem  includes  stochastic  plant  disturbances  and  measure¬ 
ment  noise  with  performance  measured  by  means  of  the  quadratic  functional 

J(t)  =  xT(t)Rix{t )  +  2zT(t)Rnu(t)  +  uT(t)R2u(t).  (1.7) 

To  obtain  a  steady-state  design  problem  we  1)  average  J  (t)  over  the  disturbance  and  measurement 
noise  statistics;  2)  pass  to  the  steady-state  limit;  and  3)  maximize  over  the  class  of  parameter 
uncertainties.  Hence  the  performance  of  a  given  controller  ( Ae ,  Be,Ce)  is  given  by 

J(Ae,Be,Ce)  =  sup  limsupIE[J(t)].  (1.8) 

e(-)  t— *oo 

The  use  of  “limsup”  is  a  technicality  which  account  for  cases  in  which  the  steady-state  limit  may 
not  exist.  Note  that  although  (1.8)  is  an  averaging  criterion  over  the  disturbances  as  in  LQG  theory, 
it  is  also  a  worst-case  measure  over  the  uncertain  parameters.  Thus  (1.8)  is  a  hybrid  criterion  in 
the  sense  that  is  stochastic  in  the  disturbance  space  (i.e.,  external  uncertainties)  and  deterministic 
in  the  parameter  space  (i.e.,  internal  uncertainties).  By  “internal  uncertainties”  we  have  in  mind 
quantities  such  as  mass,  damping  or  stiffness,  and  by  “external  uncertainties”  we  are  referring  to 
phenomena  such  as  turbulent  flow  for  which  only  power  spectrum  statistics  may  be  available.  No 
claim  is  made,  however,  with  regard  to  the  universal  validity  of  such  a  mathematical  uncertainty 
model.  In  particular  applications,  uncertainty  models  which  are  either  wholly  deterministic  or 
wholly  stochastic  may  be  more  appropriate.  In  general,  our  setting  appears  to  be  consistent  with 
the  available  literature  (see  [1-28]). 

4.  Performance  Bound.  To  obtain  a  tractable  design  problem  the  matrix  P  is  used  to  bound 
the  performance  of  each  controller  solving  the  Robust  Stability  Problem.  Specifically,  by  assuming 
in  addition  to  (1.4)  that 

p 

2>,(AtrP  +  PAi)  +  R<  n(P,Be,Ce),  (1.9) 

»=i 

it  follows  that 

J{Ae,Bc,Ce)<  trPV.  (1.10) 

In  (1.9)  and  (1.10)  R  and  V  denote  closed-loop  weighting  and  disturbance  intensity  matrices.  The 
idea  of  bounding  the  performance  by  means  of  a  Lyapunov  function  is  the  basis  for  guaranteed  cost 
control  ([14,17]).* 

*  It  is  also  interesting  to  note  that  in  Hamilton- Jacobi-Bellman  sufficiency  theory  the  performance 
functional  is  expressed  in  terms  of  a  value  function  which  also  serves  as  a  Lyapunov  function  for 
the  closed-loop  system.  These  connections  will  be  explored  in  a  future  paper. 
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5,  Construction  of  the  Lvapunov  Function.  Thus  far  the  Lyapunov  function  has  only  been 
abstractly  characterized  by  means  of  (1.3)  and  (1.4).  To  obtain  a  useful  design  theory  Q  is  now 
given  a  concrete  form.  Specifically,  to  satisfy  (1.9)  it  is  assumed  that 

p 

n{P,Be,Ce)  =  J2K(P,Be,Ce)  +  R,  (1.11) 

»= i 

where,  for  each  t,  the  are  chosen  such  that 

<r<(^  +  fi<)<A^,Bc,C'c),  \<ri\<Si.  (1.12) 

Note  that  (1.12)  implies  that  (1.4)  holds  with  H  given  by  (1.11).  Since  Ai  depends  upon  Bc  and  Cc, 
the  bound  A i  will  be  constructed  to  be  gain-invariant,  that  is,  so  that  (1.12)  holds  for  all  Bc  and 
Ce.  Thus,  no  difficulty  will  arise  from  the  fact  that  the  controller  gains  are  yet  to  be  determined 
by  optimality  considerations. 

It  should  be  noted  that  the  bounding  in  (1.12)  is  defined  in  the  sense  of  the  cone  of  nonnegative- 
definite  matrices.  Since  this  is  only  a  partial  ordering  and  not  a  total  ordering,  a  least  upper  bound 
(i.e.,  a  “sharpest*  bound)  does  not  exist  in  general  and  the  conservatism  of  the  inequality  in  (1.12) 
cannot  be  quantified  by  a  scalar  measure.  Hence,  A,  satisfying  (1.12)  is  not  necessarily  unique  and 
two  particular  choices  of  A<  are  developed  in  this  paper.  Since  we  shall  utilize  first-order  necessary 
conditions  for  optimality,  we  confine  our  consideration  to  bounds  which  are  differentiable.  The  first 
choice  of  A<  satisfying  (1.12)  is  given  by  the  linear  (in  P)  function 

HP,  Bc,Ce)  =  SiioaP  +  a-'AjPAi),  (1.13) 

where  a<  is  an  arbitrary  positive  number.  As  shown  in  [33],  the  bound  (1.13)  can  be  viewed  as 
arising  from  a  stochastic  optimal  control  problem  with  exponentially  weighted  cost  and  state-, 
control-  and  measurement-dependent  white  noise.  The  stochastic  multiplicative  white  noise  model 
serves  only  as  an  interpretation,  however,  and  need  not  be  viewed  as  having  physical  significance. 
A  similar  bound  is  utilized  in  [28]. 

The  second  choice  for  A,-  satisfying  (1.12)  is  given  by  the  quadratic  (in  P)  function 

A  i(P,Be,Cc)  =  SiiEfEi  +  PDiDjP),  (1.14) 

where  Di,E,  denote  an  arbitrary  factorization  of  A,  of  the  form 

Ai  =  DiEi.  (1.15) 
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The  bound  (1.14)  was  utilized  in  [26]  for  full-state  feedback  with  rank-1  uncertainties.  Note  that 
by  utilizing  congruence  transformations  it  can  be  seen  that  both  bounds  (1.13)  and  (1.14)  are  basis 
independent.  That  is,  replacing  A ,  by  SA.-S-1  leads  to  replacing  P  by  S~TPS~1. 

6.  The  Auxiliary  Minimization  Problem.  The  next  step  in  our  development  for  robust  perfor¬ 
mance  is  the  following.  Inasmuch  as  the  performance  of  a  robustly  stabilizing  controller  is  bounded 
via  (1.10)  over  the  given  range  of  parameter  variations,  it  is  desirable  to  minimize  the  upper  bound 

J(P,Ae,Bc,Ce)^  tr  PV  (1.16) 

subject  to  the  constraint  (1.3).  This  is  referred  to  as  the  Auxiliary  Minimization  Problem.  For 
a  given  choice  (1.13)  or  (1.14)  of  A<  for  each  »,  a  solution  of  the  Auxiliary  Minimization  Problem 
provides  a  controller  whose  steady-state  performance  is  guaranteed  to  remain  below  the  bound 
(1.16)  over  the  range  of  parameter  variations,  hence  guaranteeing  robust  performance.  Since  the 
Auxiliary  Minimization  Problem  is  a  smooth  mathematical  programming  problem,  a  minimum 
always  exists  on  compact  sets.  To  actually  characterize  extremals  of  the  Auxiliary  Minimization 
Problem  we  proceed  by  deriving  first-order  necessary  conditions.  Because  these  necessary  conditions 
are  derived  for  the  Auxiliary  Minimization  Problem,  they  effectively  serve  as  sufficient  conditions 
for  robustness  in  the  original  problem. 

It  should  be  noted  that  the  guaranteed  cost  control  approach  developed  in  [14]  does  not  permit 
this  line  of  development  since  is  given  by 

A<(/>,Be,Ce)  =  *|  AjP  +  PAil  (1.17) 

where  j  •  |  denotes  the  matrix  obtained  by  replacing  each  eigenvalue  by  its  absolute  value.  Since 
this  bound  is  not  differentiable  with  respect  to  the  controller  gains,  first-order  necessary  conditions 
cannot  be  used. 

7.  The  Optimality  Conditions:  Full-Order  Case.  For  the  full-order  case,  i.e.,  when  the  order  of 
the  controller  is  equal  to  the  order  of  the  plant,  the  first-order  necessary  conditions  can  be  derived 
in  a  form  which  is  a  direct  generalization  of  the  pair  of  separated  Riccati  equations  of  LQG  theory. 
Specifically,  the  necessary  conditions  comprise  a  coupled  system  of  four  algebraic  matrix  equations 
including  a  pair  of  modified  Riccati  equations  and  a  pair  of  Lyapunov  equations.  For  plant  models 
involving  multiplicative  white  noise  these  equations  have  been  studied  in  [34-36].  This  form  of  the 
equations  thus  essentially  corresponds  to  choosing  bound  (1.13). 
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8.  The  Optimality  Conditions:  Reduced-Order  Case.  For  design  flexibility  we  also  consider 
controllers  of  arbitrary  reduced  dimension.  For  the  linear-quadratic  problem  without  parameter 
uncertainty,  the  formulation  of  the  necessary  conditions  given  in  [29]  provides  a  generalization  of 
LQG  theory.  Specifically,  the  optimal  gains  are  characterized  by  a  system  of  algebraic  matrix 
equations  consisting  of  a  pair  of  modified  Riccati  equations  and  a  pair  of  modified  Lyapunov 
equations  coupled  by  an  oblique  projection.  When  the  order  of  the  controller  is  equal  to  the  order 
of  the  plant,  the  projection  becomes  the  identity  and  the  standard  LQG  result  is  recovered. 

The  outcome  of  the  above  development  is  a  set  of  algebraic  matrix  equations  which  corre¬ 
spond  to  the  necessary  conditions  for  the  Auxiliary  Minimization  Problem  and  hence  to  sufficient 
conditions  for  robust  stability  and  performance.  These  necessary  conditions  characterize  full-  or 
reduced-order  controllers  with  either  choice  of  bounds  (1.13)  and  (1.14)  for  each  uncertain  par 
rameter.  For  control-system  design,  these  equations  can  be  used  as  follows.  If  a  solution  to  the 
necessary  conditions  is  obtained  computationally  and  if  certain  definiteness  conditions  hold,  then 
the  explicitly  synthesized  controller  1)  solves  the  Robust  Stability  Problem  and  2)  is  guaranteed  to 
provide  robust  performance  bounded  by  tr  PV  over  the  stipulated  uncertainty  range. 

The  applicability  of  these  results  is,  of  course,  limited  to  plants  which  are  nominally  stabilizable 
via  controllers  of  the  given  order.  Indeed,  in  this  case  it  has  been  shown  in  [37]  via  topological 
degree  theory  that  the  optimality  conditions  for  the  case  $,•  =  0,  i  =  1, . . .  ,p,  possess  at  least  one 
stabilizing  solution.  For  the  parameter  uncertainty  problem,  i.e.,  Si  >  0,  it  follows  from  continuity 
properties  that  a  solution  also  exists  for  sufficiently  small  Si .  The  actual  range  of  uncertainty  which 
can  be  stabilized  and  the  tightness  of  the  performance  bound  depend  upon  the  conservatism  of 
our  bounds.  As  will  be  seen  from  a  numerical  example,  our  bounds  are  not  generally  sharp.  This 
is  not  unexpected,  however,  due  to  both  the  sense  of  the  partial  ordering  employed  in  (1.12)  and 
the  fact  that  our  choice  of  gain-invariant  bounds  permits  a  one-step,  non-iterative  synthesis  (rather 
than  analysis)  procedure.  It  should  be  noted  that  necessary  and  sufficient  conditions  for  robust 
analysis  of  a  block-structured  class  of  uncertainties  are  obtainable  using  Doyle’s  /^-function  ([6]). 
This  block  structure,  however,  does  not  appear  to  include  either  the  linear  uncertainty  model  (1.1) 
or  the  matched  uncertainty  model  of  [21]  as  special  cases. 

In  the  present  paper  we  present  results  of  an  illustrative  numerical  study  for  a  well-known 
example  of  Doyle  used  in  [2]  to  demonstrate  the  lack  of  gain  margin  for  LQG  controllers.  This 
type  of  uncertainty  is  a  special  case  of  (1.1)  obtained  by  taking  p  =  m  and  defining  Bi  to  be  the 
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matrix  whose  »‘th  column  is  the  same  as  the  ith  column  of  B  and  zero  otherwise.  To  obtain  full- 
order,  robustified  controllers  exhibiting  performance/robustness  tradeoffs,  we  utilize  bound  (1.13) 
for  several  values  of  Si.  To  obtain  these  numerical  results  we  utilized  a  straightforward  iterative 
algorithm  which  requires  only  an  LQG-type  software  package.  The  homotopy  algorithm  of  [37]  with 
appropriate  extensions  can  also  be  used.  Further  descriptions  of  related  algorithms  and  numerical 
results  can  be  found  in  [38-40]. 

The  development  herein  is  self-contained  with  the  exception  that  the  detailed  derivation  of 
the  optimality  conditions  has  been  omitted.  In  specialized  cases  the  derivation  has  been  given 
previously.  For  the  case  of  bound  (1.13)  only,  a  derivation  using  Kronecker  products  appears  in 
[36].  Also,  a  derivation  without  parameter  uncertainties  has  been  given  in  [29]  using  Lagrange 
multipliers.  Overall,  the  derivation  involves  considerable  matrix  manipulation.  Since  the  detailed 
derivation  does  not  appear  to  warrant  the  required  space,  we  give  an  outline  of  the  proof  to  assist 
the  sufficiently  motivated  reader  in  reconstructing  the  details. 


dotation  and  Definitions 


Note:  All  matrices  have  real  entries 

IR,  IRrX*,  IRr,  IE  real  numbers,  r  x  a  real  matrices,  IRrX1,  expectation 

||  •  ||  Euclidean  vector  norm 

Ir,  0rXI,  0r  r  x  r  identity  matrix,  r  x  s  zero  matrix,  0rXr 

(  )r»  (  )-1>  (  )~T  transpose,  inverse,  inverse  transpose 

tr  trace 


0,  ® 

Sr 

INr 

IPr 

Z\  >  z% 

Z\  >  Zi 

asymptotically  stable  matrix 
n,  m,  l,  p,  Tie  i  n, ,  mj 
fi,  fii 

x,  u,  y,  xc 
A,Ai]  B,  Bi\  C,Ci 


Kronecker  sum,  Kronecker  product  ([41]) 
r  x  r  symmetric  matrices 

txt  symmetric  nonnegative-definite  matrices 
rxr  symmetric  positive-definite  matrices 
Z\  —  Zi  £  INr,  Z\,  Z%  €  Sr 

Z%  —  Zj  €  IPr,  Z\,  Z<i  €  Sr 

matrix  with  eigenvalues  in  open  left  half  plane 
positive  integers,  »  €  {1, . . .  ,p} 
n  +  ne,  ni  +  rn^,  t  €  {l,...,p} 
n,  m,  l,  ne-dimensional  vectors 

n  x  n  matrices;  n  x  m  matrices;  lx  n  matrices;  i  S  {1, . . .  ,p} 
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Ac  y  i  C, 

A,  A, 


»  €  {1,  ,p) 


S% 

A 

<*i 

a 

*.(•) 

<f() 

Loo([0,oo),A) 

a, 

D„  k, 

Dc,  Ek 

E" 

Ri 

R 2 

Rn 

R 

™i(-) 

u;2(-) 

Vi 

V, 

Vl2 

V 


n,  x  r»,,  n,  x  l,  m  x  n,  matrices 


A  SC, 

A%  BcC, 

.BtC  A4 

B.C .  0 

positive  number, «  €  { 1,  ■  ,p) 

*  •"  *  \-S,,6,\ 
real  number,  i€{l,  ,p) 

(*t 

Lebesgue  measurable  function  on  [0,  oo),  i  €  {1,  .  ,p) 
(*i() . *,()) 

Lebesgue  measurable  function*  on  JO,  oo)  with  value*  in  A 
poeitive  number,  i€{l,...,p} 

nxn,,  n,xn,  nx  m,,  m,  x  m  matrices,  i  6  ,p) 

n  x  n,,  n,  x  n  mat r ice* ,  i  €  {1,  . . . ,p) 
see  Section  6 

state  weighting  matrix  in  IN" 

control  weighting  matrix  in  IP”* 

n  x  m  croes  weighting  matrix  such  that  R, 

CfRf,  CJ  KjC, 

n-dimensional  white  noise 
^-dimensional  white  noise 
intensity  of  u>i(-)  in  IN" 
intensity  of  u/j(-)  in  IP4 
nx  t  cross  intensity  of  uxj  (-) ,  u/2  (*) 

'  Vi  V„flf  ' 

B.V&  BeVjBj 


3.  Robust-Stability  and  Robust  Performance  Problems 

In  this  section  we  state  the  Robust  Stability  Problem  and  Robust  Performance  Problem  along 
with  related  notation  for  later  use. 

Robust  Stability  Problem.  For  fixed  ne  <  n,  determine  (Ac,  Be,Ce)  €  IRn'x"‘  x  IRn'xt  x 
IR”1*"'  such  that  the  closed-loop  system  consisting  of  the  nth-order  controlled  plant 

p  p 

*(0  =  (A  +  ^2&i(t)A^x(t)  +  (B  +  ^o,(t)S,)u(t),  o.a.  t  e  [0, oo),  (3.1) 

»=i  »=i 


8 


measurements 

y(0  =  (c  +  £>,(0c.)*(0,  (3.2) 

«=i 

and  neth-order  dynamic  compensator 

i<{t)  =  AcXe{t)  +  Bcy{t),  (3.3) 

t*(t)  =  Cexe{t),  (3.4) 

is  asymptotically  stable*  for  all  £(•)  G  ^^((O.oo),  A). 

Robust  Performance  Problem.  For  fixed  ne  <  n,  determine  (Ae,  Be,Ce)  G  IRn**n*  x  IRn*x4  x 
E*x"'  such  that,  for  the  closeo-loop  system  consisting  of  the  nth-order  controlled  and  disturbed 
plant 


p  p 

±(i)=  (A  +  £*<(t)A,)z(t)+  (jB  +  j3^(*)&)tt(0  +  «i(0»  o.o.  t  €  [0,  oo),  (3.5) 

S  (=1  ml 

noisy  measurements 

y(0=  (c+'jr&i(t)C^z(t)  +  wt(t),  (3.6) 

»=1 

and  «cth-order  dynamic  compensator  (3.3),  (3.4),  the  performance  criterion 

7(Ae,Be,Ce)=  sup  limsupIE[zT(t)i?1z(t)  +  2xT (t)Ri2u(t)  +  uT(t)J?2u(t)]  (3.7) 

e(}€£o.([0,oo),O)  t— oo 


is  minimized. 

For  each  controller  [Ac,  Bc,Ce)  and  parameter  variation  o(-)  €  Loo([0,oo),  A)  the  undisturbed 
closed-loop  system  (3.l)-(3.4)  is  given  by 

x(t)  =  (A  +  ^2&i[t)Aijx(t),  o.o.  t  G  [0,oo),  (3.8) 

«=i 

while  the  disturbed  closed-loop  system  (3.3)-(3.6)  is 

P 

z(t)  =  -I- ^Oi(t)Aijz(t) tij(t),  a. a  t  G  [0,oo).  (3.9) 

»=i 

*  Asymptotic  stability  for  a  nonautonomous  system  is  defined  in  the  standard  way.  See,  e.g., 
[42). 
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Also  (see,  e.g.,  [43],  p.  194),  let  $  :  (0,oo)  — »  IR"Xn  be  the  unique  absolutely  continuous  solution 
to 

$(t)  =  (A  +  ^Oi(i)A^<l(t),  a.a.  t  €  [0, oo),  (3.10) 

»=i 

*(0)  =  In,  (3.11) 

and  recall  that  $-1(*)  satisfies 

A  p 

= -*-x(t)  (a  +  £  *<(*)*) ,  o.o.  t  6  [0,oo).  (3.12) 

«=i 

4.  Sufficient  Conditions  for  Robust  Stability  and  Performance 

For  robust  stability  we  characterize  quadratic  Lyapunov  functions  for  the  closed-loop  system. 
Theorem  4.1.  Let  fl  :  IP*  x  IRn‘xt  x  IRmXn*  _>  SA  satisfy 

p 

^aiiAfP  +  PAi)  <n(P,BeiCe),  06  A,  (P,Bc,Ce)  €  IP*  x  LRn-x*  x  IRmxn-.  (4.1) 

«=i 

If,  for  some  (Ae, Bc,Ce)  6  IRn*xn*  x  IRn“xt  X  IRmXn*,  there  exists  P  €  IP"  satisfying 

0=  ATP  +  PA  +  n{P,Be,Cc),  (4.2) 

then  ( Ae,Bc,Cc )  solves  the  Robust  Stability  Problem. 

Proof.  Define  the  Lyapunov  function 

V{x)  =  xTPx,  ieIR*. 

For  t  6  [0,oo)  and  x{t)  satisfying  (3.8),  it  follows  from  (4.2)  that 
V  (x(t))  =  xT(t)Px(t)  +  xT{t)P  i(t) 

=  xT(t)  [(a + £  mo*)  tp  +  p(a+£i  mo*)]  m 

i=i  »=i 

=  xT(f)  [£>(*) (*?>  +  PAi)  -n(P,Bc,Cc)]x(t). 

1=1 

Since  o(t)  €  A,  t  6  [0,oo),  it  follows  from  (4.1)  that  there  exists  7  >  0  such  that  V(x(t))  < 
“7p(0lla»  1  €  [0,oo).a 
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i*l.  If  ( Ae,Be,Ce )  solves  the  Robust  Stability  Problem  then 


lim  $(0  =  0,  £(•)  €  loo ([0, oo),  A) .  (4.3) 

OQ 

Remark  4.2.  As  will  be  seen  the  bound  (4.1)  will  be  guaranteed  for  all  P,Bc,Ce  by  suitable 
construction  of  the  function  O.  In  addition,  the  existence  of  a  solution  P  to  (4.2)  need  not  be 
verified  in  practice.  Rather,  (4.2)  is  a  result  of  numerically  solving  the  necessary  conditions  for  the 
Auxiliary  Minimization  Problem  given  by  Theorem  6.1. 

For  the  Robust  Performance  Problem  the  cost  can  be  expressed  in  terms  of  the  closed-loop 
second-moment  matrix. 

Proposition  4.1.  For  ( Ac,Bc,Ce )  €  IRn«xn*  x  IRn“x£  x  JRmXn*  and  £(•)  6  Loo  ([0,  oo),  A)  the 


second-moment  matrix 


<3(t)  =  IE[*(t)*T(t)],  t£[0,oo), 


satisfies 


p  p  y 

4(0  =  (A  +  ^ffi(0A,)<3(0  +  <3(0(^  +  II^(0^)  -t-v\  Q.o.te[0,oo),  (4.5) 


or,  equivalently, 


<3(0  =  $(0Q(O)$T(0  +  f  *(t)irl(s)V$-T(s)$T{t)ds,  t  €  (0, oo). 

Jo 


Furthermore, 


or,  equivalently, 


J(Ae,  Be,Ce)  =  sup  lim  sup  tr  <3(0 

»(}ei.00([0,oo),A)  t  — oo 


J(Ae,  Be,Cc) 


»()€L 


sup  limsup  tr  [$(0Q(0)$T(0-R  +  [  $(0$  1  {s)V$~T  [s)$T  (t)dsR\ . 
oo((0,oo),A)  t— >oo  t  Jq  J 


Proof.  The  second-moment  equation  (4.5)  is  a  direct  consequence  of  the  Ito  differential  rule 
(see  [44],  p.  142)  while  (4.6)  follows  by  direct  verification.  Finally,  (4.7)  is  immediate.  □ 

We  now  proceed  to  obtain  an  upper  bound  for  J  in  terms  of  the  matrix  P.  The  following 
lemma  is  required. 
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Lemma  4,1.  Let  fi  :  IPAxIRn*xtxIRmxn*  -*■  SA  and  ( Ae,Be,Ce )  6  IRn,Xn*  xIRn*x4xIRmXn* 
be  given.  Then  P  €  IPA  satisfies  (4.2)  if  and  only  if  P  satisfies 
p  =  $T(*)^(t) 

+  j*  $T(t)$“T(a)  [n(^,  se,  ce)  -  £>(t)(Af/>  +  J>A0]$-‘(«)s(0<fo,  (4.9) 

*(')  €  Loo((0,oo),  A),  t  €  (0,oo). 

Proof.  Suppose  P  satisfies  (4.2).  Then,  for  t  €  [0,  oo), 

0  =  $“T(t)  (A  +  J2 *#)&) Tp*~\t)  +  *~T(t)P  (A  +  &i{t)Ai) *~l (t) 

*=1  i=l 

+  *-T(t)[n{P,Be,ce)  -  32a,(t)(A?p  +  PAi)]*-l(t) 

isst 

=  -|[*~r(*)^'1(0]  +*-2’(o[n(^,Be,ce)  -  32*i(t)(A?p  +  />*)]*-1(0, 


which  yields 


0  =  -9-T(t)P*-\t)  +  P  +  £*-T(s)[a{P,Bc,Ce)  -'p»i(*)(X[P  +  JA.-)]*-»(#)is 


Thus  (4.9)  is  satisfied.  Conversely,  suppose  P  satisfies  (4.9).  Differentiating  with  respect  to  t  using 
Leibniz’  rule  yields 


0  =  (^  +  E  *(*)*)  (0^(0  +  *TM  +  X>(0*) 

»=1  «=1 

+  (A  +  ^d,(t)A,)T  /“$r(t)<|-r(s)[n(P,Se,Cc)  -  f2*i(»){A?P  +  ^A,)]4-l(-)«S(t)ds 

«i  Jo  i=i  1 

+  £*T(t)*-T(s)[n(P,Be,ce)  -  2>(s)(if/>  +  ^)]*-‘w*(0*(a  +  J>(0*) 

0  >= i  *=i 

+n  (p,Be,ce)  -32*imAjp  +  PAi) 

»= i 

=  (a  +  £*<(t)Ai)r/>  +  P (a  +  E*W*)  +  n(p,Be,ce)  -  £ai{t)(AlP  +  pa,) 

*=i  «=i  >=i 

=  AtP  +  PA  +  n{P,Bc,Ce). 

Hence  (4.2)  is  satisfied.  □ 


Remark  4,3.  Note  the  identity 

tr  f  $(t)$~1{s)VQ-T(a)$T(t)dsR  =  tr  [  $>T(f)$_T(a)R<&'1(s)$(t)dsV' ,  (4.10) 

Jo  Jo 
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(4B{)Cc)6En'XB*xr‘x‘xEm,<fl<l  &{■)  e  Loo([0,oo),A),  te[0,oo). 

We  are  now  in  a  position  to  bound  the  cost  J  by  means  of  the  matrix  P . 

Theorem  4.2.  Let  Cl  :  IP*  X  IRn*x4  X  nr**"-  —  S*  satisfy  (4.1)  and 

p 

^2<n(A?P  +  PAi)  +  R  <  n(P,Be,Cc),  *6  A,  (P,Be,Cc)  e  IP"  x  IRn,x4  x  JRmxn*.  (4.11) 

i=l 

If,  for  some  ( Ae,Be,Ce )  €  IRn*x'‘*  x  IRn*x4  x  IRmXn*,  there  exists  P  €  IP"  satisfying  (4.2),  then 

J(Ae,Be,Ce)  <  tr  PV.  (4.12) 

Proof.  From  (4.8)-(4.10)  and  (4.3)  it  follows  that 
J(Ac,Be,Cc)=  sup  Umsup  tr{$(t)Q(0)$r(t)R+/>V-$r(0^(0^ 

»()€i«.([0,oo),A)  t— °o 

-  r  iT{t)9-T{a)[n(P,Be,Ce)  -  R-J2&i(8)(A'[P  +  P  Ai)\<b~l{$)${t)dsV  } 
Jo  ,=1 

<  sup  limsup  tr[$(t)Q(0)$T(t)i?  +  PV] 

a(  )ex,«,([0,oo)1A)  t— oo 

=  tr  PV.  □ 

Remark  4.4.  Note  that  since  R  >  0,  (4.11)  implies 

+  /U4<n(^Bc,C<),  «r€A,  (4.13) 

»=i 

which  is  a  weak  form  of  (4.1).  If  R  >  0  then  (4.11)  implies  (4.1).  This  implication  is  not  surprising 
since  (4.11)  implies  robust  performance  while  (4.1)  implies  robust  stability. 

5.  Choiw  9f  Bo.UD.da 

To  satisfy  (4.11)  fi(*,*>')  is  chosen  to  be  of  the  form 

p 

n(P,Be,Ce)  =  '£Ai(P,Be,Ce)  +  R,  (5.1) 

«=x 

where,  for  each  »  =  1, . . .  ,p,  A<  :  IP"  x  LRn,x4  x  IR"txn»  — »  S"  satisfies 

^(AfP  +  PA.)  <  Ai(P,Bc,Ce),  *€[-*,*],  (P ,  Be,  Ce)  €  IP"  x  IRn*x4  x  IRmxn*.  (5.2) 
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Two  distinct  choices  for  the  bound  A<  are  considered.  As  pointed  out  in  Section  1,  the  first 
choice  corresponds  to  a  right  shift/multiplicative  white  noise  model  ([33]),  while  the  second  bound 
generates  results  found  in  [26] . 

Proposition  5.1.  For  all  >  0  the  function 

A  <(/>,£., C.)  =  6i(aiP  +  a-'AjPAi)  (5.3) 


satisfies  (5.2). 


Proof.  Note  that 

0  <  [*<(«.•/*)*/»  -  (*/«)* AifPfciai/Si)* I*  -  (5,>,)*A,] 
=  a}{ai/Si)P  +  {Si/a^AfPAi  -  at{Af  P  +  P At), 
which,  since  a*  <  Sf,  implies  (5.2).  □ 


Proposition  5.2.  For  all  D i  €  IRnxn<  and  Ei  €  IR"'*"  satisfying 

A\  =  Di  Ei , 


the  function 


satisfies  (5.2). 


A  i(P,Be,Cc)  =  StiEfEt  +  PbtbJP) 


Proof.  Note  that 

0  <  [sf  Ei  -<riS~iDjP]T [5?  Ei  -  <7,5"*  Dj P) 

=  SiEjEi  +  {af/Si)PbibfP  -  <Tt{A? P  +  PAi), 

which  implies  (5.2).  □ 


(5.4) 

(5.5) 


6.  The  Auxiliary  Minimization  Problem  and  Necessary  Conditions  for  Optimality 

To  optimize  robust  performance  while  retaining  robust  stability,  we  consider  the  following 
problem  for  which  the  cost  functional  is  given  by  the  bound  (4.12). 

Auxiliary  Minimization  Problem.  For  i  =  l,...,p  let  A i  be  given  by  either  (5.3)  or  (5.5). 
Determine  (P ,Ae,Be,Ce)  €  IP”  x  IRn*xn”  x  IRn,xi  x  IR’"X,,•  which  minimizes 

J(P,Ae,Bc,Cc)=  it  PV  (6.1) 
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subject  to 


0  =  AtP  +  PA  +  Be,Ce)  +  R 


i{AlP  +  PAi)<Y,k(P>B"C')  +  *’  ffeA'  M 

«=i  »=i 

Remark  6.1.  Note  that  (6.3)  enforces  both  (4.1)  and  (4.11)  to  guarantee  robust  stability  and 
performance. 

To  derive  first-order  necessary  conditions  for  the  Auxiliary  Minimization  Problem,  note  that 
the  constraint  (6.3)  defines  an  open  set. 

Proposition  6.1.  The  set  of  ( P,Bc,Ce )  e  P*  X  IRn<x4  x  JRmXn*  satisfying  (6.3)  is  open. 
Proof.  Since  A<(-,  •,  ■)  is  continuous  it  can  be  shown  that  the  function 

f(P,Be,Ce)  =  rninAmin{]£A y(P,Be,Ce)  +  R  -J^<n{AjP  +  PA,)} 

t— X  tssl 

is  also  continuous.  Since  (6.3)  is  equivalent  to  0  <  f(P ,  BCyCe),  the  result  is  immediate.  Q 

To  obtain  explicit  feedback  gain  expressions  we  shall  require  two  additional  technical  assump¬ 
tions.  If  bound  (5.3)  is  chosen  for  a  given  i  €  {1,  •  • .  ,P }  we  require 

Bi  ^  0  =s>  Ci  =  0,  (6-4) 

i.e.,  By  and  Cy  are  not  simultaneously  nonzero.  Of  course,  both  Bi  and  C,-  may  be  zero.  Assumption 
(6.4)  implies  that  parameter  uncertainties  in  B  and  C  must  be  modeled  as  uncorrelated.  Correlation 
between  uncertainties  in  A  and  B  or  A  and  C  is,  of  course,  permitted.  Furthermore,  if  bound  (5.5) 
is  chosen  for  a  given  i  €  {1, . . .  ,p}  we  require 


Cy  =  0. 


When  utilizing  bound  (5.3)  the  positive  constant  shall  be  considered  fixed  but  arbitrary. 
Furthermore,  for  bound  (5.5),  let  Di  €  IRnxn',  Ey  €  IRn' xa,  Hi  €  IR  ’  and  K%  €  IR 


satisfy 


Ai  —  DyEi,  Bi  —  HiKi, 


and  define  Di,Ei  satisfying  (5.4)  by 


0f>j  Xn, 

» 

— * 

_  0mjX» 

KiCe 

(6.7) 


In  addition  to  the  open  set  defined  by  (6.3),  the  derivation  of  the  necessary  conditions  requires  that 
( P,Ae,Be,Ce )  be  further  restricted  so  that 


+  £"  SiDiDfP)  0(A  +  i£'  W«  +  £  "St'DibJP) 
+  £  ($./ot,)A,-  ®  A,-  is  asymptotically  stable 


(6.8) 


and 

( Ae,Be,Ce )  is  controllable  and  observable.  (6.9) 

In  (6.8)  the  notation  Y2'  ^d  J2"  denotes  summation  over  indices  for  which  bounds  (5.3)  and  (5.5), 
repectively,  have  been  chosen.  Note  that  (6.8)  and  (6.9)  play  no  role  in  the  Auxiliary  Minimization 
Problem  and  thus  need  not  be  verified  for  robust  stability  or  robust  performance. 

For  arbitrary  Q,P,Q,  P  €  lRnxn  define  the  following  notation: 

n,.  -  B,  +  Vu  =  V,  +  ^(VoiJCiW  +  Q )CT, 

P.  =  BTP+  Rf,  +  E  ({./Oijflf  (P  +  P)A„  Q.  S  QCT  +  Vtl  +  53'(t./“.)'».(<3  +  Q)cf, 

VgE"l‘(°‘D‘T  +  B^E” 

a  =  a  +  \E's‘^!-  af  =  a-br;‘p„  Aq  =  A-Q.v,-lc. 

The  following  lemma  will  be  needed. 

Lemma  6.1.  If  Q,P  €  INn  and  rank  QP  =  ne,  then  there  exist  G,T  €  IR”‘’xn  and  invertible 
M  €  iRn« x  n«  3Uch  that 

QP  =  GtMT,  (6.10) 

TGT  =  (6.11) 


Furthermore,  G,  M  and  T  are  unique  except  for  a  change  of  basis  in  IRn,’ . 


Proof.  The  result  is  an  immediate  consequence  of  [45] ,  Theorem  6.2.5,  p.  123.  □ 

Note  that  because  of  (6.11),  the  n  x  n  matrix  r  =  Grr  is  idempotent,  i.e.,  r2  =  r.  Since  r  is 
not  necessarily  symmetric,  it  is  an  oblique  projection.  Also,  define  r±  =  I„  -  r. 
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Theorem  6.1.  Suppose  (P ,Ae>Bc,Ce)  solves  the  Auxiliary  Minimization  Problem  subject  to 
(6.8)  and  (6.9).  Then  there  exist  P,QtPyQ  6  IN"  such  that  P ,AetBc,Cc  are  given  by 

_  r p+p  ~pgt  i  .  , 

-GP  GPGT  ’  ^612^ 


Ae  =  r(A  -  QaVfalC  -  BR^Pa  +  DP)GT ,  (6.13) 

Bc  =  TQaV2~\  (6.14) 

Ce  =  -Rja  P*GT,  (6.15) 

and  such  that  P,Q,P,Q  satisfy 

0  =  AtP  +  PA  +  Ri  +  £'(*/«.) [A? PAi  +  (A,-  -  QaV2-lCif  P{Ai  -  QaVfalCi)] 

+  E  +  PDP  -  Pj R^P*  +  rZP?R£PaTXi  (6.16) 

0  =  [A  +  D(P  +  P)]Q  +  Q[A  +  D{P+  P)]T  +  Vl  +  J2\Si/*i)[AiQA? 

+  (Ai-  BiRf*  Pa)Q(Ai  -  BiR^Paf]  -  QaVfalQl  +  rj,  (6.17) 

0  =  {Aq  +  DP)T P  +  P{Aq  +  DP)  +  PDP  +  PfR^Pa  ~  rjpj RgParu  (6.18) 

0  =  {AP  +  DP)Q  +  Q{AP  +  DP)t  +  Q.VfjQl  -  r rf ,  (6.19) 

rank  Q  =  rank  P  =  rank  QP  =  nc.  (6.20) 


Conversely,  if  there  exist  P,Q,P,Q  €  INn  satisfying  (6.16)-(6.20),  then  P  given  by  (6.12)  satisfies 
(6.2)  or,  equivalently,  (4.2)  with  ( Ac,Bc,Cc )  given  by  (6.13)-(6.15). 


Outline  of  Proof.  As  discussed  in  Section  1,  we  limit  the  presentation  of  the  proof  to  the  salient 
details.  First  note  that  with  the  choice  of  bounds  A,,  (6.2)  becomes 

°  =  (A  +  J^' Siaih)TP  +  P (A  +  i  T' W»  +  R 

2  .  .  ,,  2  .  .  (6-21) 

+ Y  (5</q<)a? p* + Y  E'  +  pD>Df p)- 

By  introducing  multipliers  A  €  IR,  A  >  0,  and  Q.  €  IRnxn,  a  Lagrangian  can  be  defined  as 

C(P,Ae,Bc,Cc)=  tr[A^V+ fi(RHSof  (6.21))].  (6.22) 


Setting  dC/dP  =  0  and  utilizing  (6.8)  implies  that  A  =  1  without  loss  of  generality,  Q  >  0,  and  Q 
satisfies 

0 = (A + \  Y‘  5*a‘/s + T,"  b'bT<  p)Q  +  + \Yl  8'a'^  + 

+  ^'(5t/a,)A,2Af  +  V. 


Y"b'bTp? 


(6.23) 
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The  remainder  of  the  derivation  is  exactly  parallel  to  the  techniques  utilized  in  [29,36].  Briefly,  the 
principal  steps  are  as  follows: 

Step  1.  Compute  d£/dAe,d£/dBe  and  d£/dCe\ 

Step  2.  Use  (6.9)  to  show  that  the  lower  right  ne  x  nc  blocks  of  Q  and  P  are  positive 
definite; 

Step  3.  Use  d£/dAc  =  0  to  define  a  projection  r  and  new  variables  P,Q,P,Q,G,  T; 

Step  5.  Partition  (6.21)  and  (6.23)  into  six  equations  (#1,.  ..,#6)  corresponding  to 
the  n  X  n,  n  x  ne  and  ne  x  ne  blocks  of  P  and  2,  respectively; 

Step  6.  Use  equations  #2  and  #3  to  solve  for  Ac\  show  that  equations  #5  and  #6  also 
yield  Ac\  note  that  with  Ac  now  given,  equations  #3  and  #6  are  superfluous 
and  can  be  eliminated; 

Step  7.  Manipulate  equations  #1,  #2,  #4  and  #5  to  yield  (6.16)-(6.19); 

Step.  6.  Show  that  Steps  5-7  are  reversible  so  that  (6.16)-(6.20)  are  equivalent  to  (6.2) 
or,  equivalently,  (4.2).  □ 

By  enforcing  the  strict  inequalities  P  >  0  and  (6.3),  solutions  of  (6.16)-(6.20)  guarantee  robust 
stability  with  a  robust  performance  bound.  The  following  result  follows  from  Theorem  4.1,  Theorem 
4.2  and  the  converse  of  Theorem  6.1. 

Theorem  6.2.  Suppose  there  exist  P,Q,P,Q  €  IN"  satisfying  (6.16)-(6.20),  and  suppose  that 
(6.3)  and  P  >  0  are  satisfied  with  (P,  Ac,  Bet  Cc)  given  by  (6.12)-(6.15).  Then  the  compensator 
Ac,Be,Ce  given  by  (6.13)-(6.15)  solves  the  Robust  Stability  Problem  and  the  closed-loop  perfor¬ 
mance  (3.7)  satisfies  the  bound 

J{Ae,  Bc,Ce)  <  tr  PV.  '  (6.24) 

The  following  existence  result  concerns  the  solvability  of  (6.16)-(6.20).  Let  nu  denote  the 
dimension  of  the  unstable  subspace  of  the  plant  dynamics  matrix  A. 

Theorem  6.3.  Assume  nc  >  nu,  Rx  >  0,  Vi  >  0,  suppose  the  nominal  plant,  i.e.,  (3.1),  (3.2) 
with  Si  =  0,i  =  l,...,p,  is  stabilizable  and  detectable  and,  in  addition,  is  stabilizable  by  means 
of  an  neth-order  strictly  proper  dynamic  compensator  (3.3),  (3.4).  Then  there  exist  Si,...,Sp  >  0 
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such  that  if  6i  €  [0,5<),«  =  then  (6.16)-(6.20)  have  a  solution  P,Q,P,Q  €  IN"  for  which 

(Ac,Be,Cc)  given  by  (6.13)-(6.15)  solve  the  robust  stability  problem  with  robust  performance 
bound  (6.24). 


Proof.  From  Theorem  3.1  of  [37]  it  follows  that  there  exists  a  solution  to  (6.16)-(6.20)  which 
stabilizes  the  nominal  plant.  By  continuity  there  exists  a  neighborhood  over  which  robust  stability 
with  performance  bound  (6.24)  holds.  □ 

Theorem  6.3  is  an  existence  result  which  guarantees  solvability  of  the  sufficiency  conditions  over 
a  range  of  parameter  uncertainties.  The  actual  range  of  uncertainty  which  can  be  bounded  and 
the  conservatism  of  the  performance  bound  are  problem  dependent.  To  this  end  we  now  consider 
a  numerical  example. 


7.  Illustrative  Numerical  Example 

To  demonstrate  the  above  theory  we  present  an  illustrative  numerical  example.  The  exam* 
pie  chosen  was  originally  used  in  [2]  to  illustrate  the  lack  of  a  guaranteed  gain  margin  for  LQG 
controllers.  This  example  was  also  considered  in  [35]  for  a  preliminary  robustness  study  and  recon¬ 
sidered  in  [46]  using  p-analysis.  Define 


n  =  nu  =  2, 


m  =  l  =  p  =  1, 


1 

0  1  |  ’ 


C  =  [  1  0], 


Ai 


0  O' 

0  0  ’ 


Ca  =  [0  0], 


Ri=v1 


60  60' 
60  60  ’ 


R12  =  Vn  = 


i?2  =  V2  =  1. 


Note  that  the  system  is  open-loop  unstable  and  becomes  uncontrollable  at  ax  =  —  1.  As  can  be  seen 
using  root  locus,  a  strictly  proper  stabilizing  controller  must  be  of  at  least  second  order.  Hence  we 
consider  (6.16)-(6.20)  with  ne  =  n  and  rj.  =  0.  Furthermore,  we  utilize  bound  (5.3)  and  thus  set 
D  =  E  =  0.  Using  algorithms  described  in  [38-40],  controllers  were  obtained  by  solving  (6.16)- 
(6.20)  for  (5i,oti)  =(.1,1),  (.2,2)  and  (.4,4).  As  stated  previously,  these  numerical  solutions  also 
verify  (4.2)  with  P  given  by  (6.12).  Figure  1  compares  the  guaranteed  robust  stability  region  to 
the  “actual”  robust  stability  region.  This  robust  stability  region  was  evaluated  assuming  constant 
<7 1  (•)  although  the  theory  actually  guarantees  robustness  with  respect  to  time- varying  uncertainties. 


Thus,  the  gap  between  these  regions  may  not  be  a  rejiable  measure  of  the  conservatism  of  the  results. 
Note,  however,  that  the  design  approach  appears  to  provide  more  stability  than  is  guaranteed  a 
priori.  Much  of  this  conservatism  may  be  attributable  to  the  desire  for  a  symmetric  stability 
interval  so  close  to  an  unstabilizable  plant  perturbation,  i.e.,  <j\  =  —  1.  Nevertheless,  the  stability 
design  objectives  have  been  met  in  accordance  with  Theorem  6.2.  Interestingly,  the  form  of  the 
actual  stability  region  mimics  the  classical  6  dB  downward/infinite  dB  upward  gain  margin  of 
full-state-feedback  LQR  controllers  ([l]).  Thus,  this  approach  appears  to  provide  an  alternative 
to  gain-margin  recovery  techniques  ([9])  which  address  this  specialized  form  of  plant  uncertainty. 
Finally,  Figure  2  compares  guaranteed  closed-loop  performance  to  actual  closed-loop  performance 
over  the  guaranteed  closed-loop  robust  stability  region.  Again  the  “actual”  region  was  determined 
for  constant  Controller  gains  are  given  in  Table  1.  Finally,  it  is  interesting  to  note  that  higher 

order  robust  controllers  were  obtained  for  this  example  in  [46]  using  the  ^-function  approach. 
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Abstract 


A  model-reduction  problem  is  considered  which  involves  both  Lj  (quadratic)  and  (worst- 
case  frequency-domain)  aspects.  Specifically,  the  goal  of  the  problem  is  to  minimize  an  Lj  model- 
reduction  criterion  subject  to  a  prespecifieu  constraint  on  the  model-reduction  error.  The 
principal  result  is  a  sufficient  condition  for  characterizing  reduced-order  models  with  bounded 
L%  and  approximation  error.  The  sufficient  condition  involves  a  system  of  modified  Riccati 
equations  coupled  by  an  oblique  projection,  i.e.,  idempotent  matrix.  When  the  constraint  is 
absent,  the  sufficient  condition  specializes  to  the  £>]  model-reduction  result  given  in  Hyland  and 
Bernstein,  1985. 
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1.  Introduction 


One  of  the  most  fundamental  problems  in  dynamic  systems  theory  is  to  approximate  a  high- 
order,  complex  system  with  a  low-order,  relatively  simpler  model.  The  resulting  reduced-order 
model  can  then  be  used  to  facilitate  the  analysis  of  complex  systems  as  well  as  the  design  and 
implementation  of  feedback  controllers  and  electronic  filters.  The  model-reduction  problem  thus 
reflects  the  fundamental  engineering  desire  for  simplicity  of  implementation  and  parsimony  of  hard¬ 
ware. 

In  view  of  the  practical  motivations  for  the  model-reduction  problem,  it  is  not  surprising  that 
significant  effort  has  been  devoted  to  this  problem  in  recent  years.  Indeed,  there  now  exists  a  well- 
developed  theoretical  foundation  for  model  reduction  under  a  variety  of  approximation  criteria. 
Expanding  on  the  original  work  of  Adamjan,  Arov  and  Krein,  1971,  progress  was  achieved  in  Rung 
and  Lin,  1981,  Lin  and  Rung,  1982,  Glover,  1984,  Latham  and  Anderson,  1985,  Hung  and  Glover, 
1986,  Anderson,  1986,  Ball  and  Ran,  1987,  and  Parker  and  Anderson,  1987,  for  the  Hankel-norm 
approximation  criterion.  Many  of  the  cited  works  also  present  bounds  for  the  closely  related  H ^ 
approximation  error,  although  the  optimal  Hoa  model-reduction  problem  remains  open.  Alterna¬ 
tively,  early  progress  on  the  model-reduction  problem  with  a  quadratic  (L2)  criterion  was  achieved 
in  Wilson,  1970,  and  further  explored  in  Hyland  and  Bernstein,  1985. 

Although  the  Hankel  norm,  J?oo,  and  Lj  model-reduction  criteria  represent  distinct  approxi¬ 
mation  objectives,  there  exist  significant  connections.  For  example,  it  was  shown  in  Wilson,  1985, 
that  for  systems  which  are  either  single  input  or  single  output,  the  input  and  output  space  topolo¬ 
gies  can  be  redefined  so  that  the  induced  norm  of  the  Hankel  operator  coincides  with  the  L2 
system  norm.  In  addition,  the  optimization  technique  utilized  in  Wilson,  1970,  was  reapplied  to 
the  Hilbert-Schmidt  Hankel  operator  topology  in  Wilson,  1988.  In  recent  work,  Wilson,  1988a, 
has  shown  that  for  single-input  or  single-output  systems  the  quadratic  model-reduction  criterion  is 
actually  an  induced  norm  of  the  convolution  operator  itself. 

In  the  present  paper  we  attempt  a  further  unification  of  the  Lj  and  model-reduction 
objectives.  Specifically,  we  consider  an  Li  model-reduction  problem  with  a  constraint  on  the 
approximation  error.  The  underlying  idea  involves  the  suitable  application  of  a  frequency-domain 
inequality  due  to  Willems,  1971,  which  has  recently  been  applied  to  H <»,  control-design  problems 
in  Petersen,  1987,  Rhargonekar,  Petersen  and  Zhou,  1987,  and  Bernstein  and  Haddad,  1988.  The 
principle  result  of  the  present  paper  is  a  sufficient  condition  which  characterizes  reduced-order 
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models  satisfying  an  optimized  ,L2  bound  as  well  as  a  prespecified  Hoo  bound.  The  sufficient 
condition  is  a  direct  generalization  of  the  optimal  projection  approach  developed  in  Hyland  and 
Bernstein,  1985,  for  the  unconstrained  Lj  problem.  While  the  Lj-optimal  reduced-order  model 
was  characterized  in  Hyland  and  Bernstein,  1985,  by  means  of  a  coupled  system  of  two  modified 
Lyapunov  equations,  the  .Hoo -constrained  solution  in  the  present  paper  involves  a  coupled  system 
consisting  of  four  modified  Riccati  equations.  As  in  Hyland  and  Bernstein,  1985,  the  coupling  is 
due  to  the  presence  of  an  oblique  projection  (idempotent  matrix)  which  determines  the  constrained 
reduced-order  model.  When  the  Hoo  constraint  is  sufficiently  relaxed,  we  show  that  the  conditions 
given  herein  specialize  directly  to  those  given  in  Hyland  and  Bernstein,  1985.  Although  our  result 
gives  sufficient  conditions  for  Hoo  approximation,  we  also  state  hypotheses  under  which  these 
conditions  are  also  necessary. 

Although  numerical  algorithms  were  developed  in  Hyland  and  Bernstein,  1985,  for  the  “pure” 
Li  problem,  computational  methods  for  the  Hoo-constrained  problem  are  beyond  the  scope  of  the 
present  paper.  In  view  of  the  additional  complexity  engendered  by  the  Hoo  constraint,  more  sophis¬ 
ticated  algorithms  appear  necessary.  Hence  computational  methods  will  focus  on  the  homotopic 
continuation  algorithm  developed  in  Richter,  1987,  for  reduced-order  dynamic  compensation. 


Notation  and  Definitions 
IR,IRrxMRr,lE 

Ir,(  )r,0rx.,0r 

(  )* 
tr 

A  »«(£) 
m  f 
IIAWII* 

IlffMlla 

ll*MIL 

Sp,INr,IPr 
Z\  <  Zi,  Z\  <  Zi 

n,m,i,nmiq,p-,n 

x,y,ym,xm,y,x 


real  numbers,  rX  j  real  matrices,  IRrXl,  expected  value 
r  x  r  identity  matrix,  transpose,  r  x  a  zero  matrix,  0rXr 
complex  conjugate  transpose 
trace 

largest  singular  value  of  matrix  Z 

largest  eigenvalue  of  matrix  Z  with  real  spectrum 

(tr  ZZ*]i  (Frobenius  matrix  norm) 

[OMOM* 

8UPwgIR  <TB«[fl'(j")] 

r  x  r  symmetric,  nonnegative-definite,  positive-definite  matrices 
Zi  -  Zx  €  !Nr,  Zi  -  Zx  €  IPr,  Zx,Zi€  Sr 
positive  integers;  n  +  nm 
n,  Z,  l,  nm ,  l,  n- dimensional  vectors 


y  -  Vm, 


y,x 

A,B,C 

D,E 

Am , Bm  ,Cm 

A,B,C 

D,E 

R 

«(•) 

V 

-R,v 
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n  x  n,n  x  m,  l  x  n  matrices 
m  x  p,q  x  t  matrices 
nm  x  nm,  nm  x  m,l  x  nm  matrices 
r  r  l 

[C  -cm] 

EC  =  [EC  -ECr, 


A 

0  ‘ 

'  B  ' 

0 

Am . 
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Bm. 

BD  = 


BD 

BmD 


ETE,  model-reduction  error-weighting  matrix  in  IP* 
p-dimensional  standard  white  noise  process 
intensity  of  Dw('),V  =  DDT  €  IPm 


r CtRC  -  CTRCm 
-CIRC  C£RCm 

positive  constant 


BVBT  BVB* 
B~V BT  BmVBl 


2.  Statement  of  the  Problem 

In  this  section  we  introduce  the  model-reduction  problem  with  constrained  H <*,  norm  of  the 
model-reduction  error.  Specifically,  we  constrain  the  transfer  function  of  the  reduced-order  model 
to  lie  within  a  specified  radius  of  the  original  system.  In  this  paper  we  assume  that  the 
full-order  model  is  asymptotically  stable,  i.e.,  the  matrix  A  is  asymptotically  stable. 

Hoo- Constrained  La  Model-Reduction  Problem.  Given  the  nth-order  controllable  and 
observable  model 

i(i)  =  Ax{t)  +  BDw(t),  (2.1) 

y{t)  =  Cx(t),  (2.2) 

where  t  €  [0,oo),  determine  an  nmth-order  model 

±m(t)  =  Amxm(t)  +  BmDw(t),  (2.3) 

y  m(t)  =  C'mrm(t),  (2.4) 

which  satisfies  the  following  criteria: 

(i)  Am  is  asymptotically  stable; 
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(ii)  the  transfer  function  of  the  reduced-order  model  is  within  a  radius-7 


neighborhood  of  the  full-order  model,  i.e., 

||5(e)  -  lUMIU  <  7,  (2.5) 

where 

H(s)  4  EC(sIn  -  A)~lBD,  Hm(s)  4  ECm(aInm  -  Am)~l BmD,  (2.6) 


and  7  >  0  is  a  given  constant;  and 
(iii)  the  Lj  model-reduction  criterion 

J{Am,Bm,Cm )  4  tUm  ffi{[y(*)  -  ym(t)]T R[y(t)  -  ym(i)]}  (2.7) 


is  minimized. 


Note  that  the  full-  and  reduced-order  systems  (2.1)-(2.4)  can  be  written  as  a  single  augmented 
system 

x(t)  =  Ax(t)  +  Dw(t),  t  e  [0, 00),  (2.8) 

so  that  the  q  x  p  transfer  function  from  w(t)  to  Ey{t )  =  Ex(t)  is 

H(s)  —  E(sln  —  A)~lD  (2.9) 


and  (2.7)  can  be  written  as 

J{Am,Bm,Cm)  =  Urn  ffi{[£;y(0]T[^y(0]}  =  Hm  IE[xT(t)i?x(i)]  -  (2.10) 

Before  continuing  it  is  useful  to  note  that  if  Am.  is  asymptotically  stable  then  the  Li  model- 
reduction  criterion  (2.7)  is  given  by 


>7 i  Bmt  Cm)  —  tr  QR, 


(2.11) 


where  the  steady-state  covariance 


Q  4  tUm  IE [z(t)zr(i)] 


(2.12) 
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satisfies  the  augmented  Lyapunov  equation 


0  =  AQ  +  QAt  +  V. 


(2.13) 


Using  (2.11)  and  (2.13)  it  can  be  shown  that  the  Lj  criterion  (2.7)  is  an  approximation  measure 
involving  the  full-  and  reduced-order  impulse  responses  with  respect  to  an  Lj  norm. 


(2.14a) 

(2.146) 


Proposition  2.1.  The  Li  model- reduction  criterion  (2.11)  can  be  written  as 

J{Am,Bm,Cm)  =  r  II ECeMBD  -  £CmeA-*tSrnZ?|||.di) 

Jo 

or,  equivalently, 

J(Am,Bm,Cm)  =  ±  l°°  || H(ju)  -  Hm(joj)\\2Fdw. 

Proof.  It  need  only  be  noted  that  (2.11)  is  equivalent  to 

tr  f  eAtVeATtdtR  =  tr  [  EeAtDDTeATtETdt 
Jo  Jo 

=  tr  /  ( EeAtD)(EeAiD)Tdt 
Jo 

=  f"  \\Ee“b\\Ut 

Jo 

which  is  equivalent  to  (2.14a).  Finally,  (2.146)  follows  from  Plancherel’s  Theorem.  □ 

The  key  step  in  enforcing  (2.5)  is  to  replace  the  algebraic  Lyapunov  equation  (2.13)  by  an 
algebraic  Riccati  equation.  Justification  for  this  technique  is  provided  by  the  following  result. 

Lemma  2.1.  Let  ( Am,Bm,Cm )  be  given  and  assume  there  exists  Q  €  IR”Xn  satisfying 


Q  e  IN’1 


(2.15) 


and 

Then 

if  and  only  if 

Furthermore,  in  this  case, 


0  =  AQ  +  QAt  +'r~iQRQ+V. 
(A,  ['j~7QRQ  +  V"j^)  is  stabilizable 
Am  is  asymptotically  stable. 


II H(s)  -  Hm(a) |U  <  7, 


(2.16) 


(2.17) 


(2.18) 


(2.19) 
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(2.20) 

(2.21) 

(2.22) 

Proof.  Using  the  assumed  existence  of  a  nonnegative-definite  solution  to  (2.16)  and  the  sta- 
bilizability  condition  (2.17),  it  follows  from  the  dual  of  Lemma  12.2  of  Wonham,  1979,  that  A  is 
asymptotically  stable.  Since  A  is  block  diagonal,  Am  is  also  asymptotically  stable.  Conversely, 
since  A  is  assumed  to  be  asymptotically  stable,  (2.18)  implies  (2.17).  The  proof  of  (2.19)  follows 
from  a  standard  manipulation  of  (2.16);  for  details  see  Lemma  1  of  Willems,  1971.  To  prove  (2.20) 
subtract  (2.13)  from  (2.16)  to  obtain 

0  =  A{Q-Q)  +  {Q-Q)At  +  ~(-2QRQ,  (2.23) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

Q-Q-  f°°  QRQ)e*Ttdt  >  0.  (2.24) 

Jo 

Finally,  (2.21)  follows  immediately  from  (2.20).  □ 

Lemma  2.1  shows  that  the  Hoo  constraint  is  automatically  enforced  when  a  nonnegative-definite 
solution  to  (2.16)  is  known  to  exist.  Furthermore,  the  solution  Q  provides  an  upper  bound  for  the 
actual  state  covariance  Q  along  with  a  bound  on  the  Lj  model-reduction  criterion.  Next,  we  present 
a  partial  converse  of  Lemma  2.1  which  guarantees  the  existence  of  a  nonnegative-definite  solution 
to  (2.16)  when  (2.19)  is  satisfied. 

Lemma  2.2.  Let  ( Am ,  5m,CTO)  be  given,  suppose  A  is  asymptotically  stable,  and  assume  the 
Hoo  approximation  constraint  (2.19)  is  satisfied.  Then  there  exists  a  unique  nonnegative-definite 
solution  Q  satisfying  (2.16).  Furthermore,  (A+i~2 QR,V*  )  is  stabilizable  if  and  only  if  A+i~i  QR 
is  asymptotically  stable. 

Proof.  The  result  is  an  immediate  consequence  of  Theorems  3  and  2,  pp.  150  and  167  of 
Brockett,  1970,  and  the  dual  of  Lemma  12.2  of  Wonham,  1979.  □ 

Finally,  we  show  that  the  quadratic  term  7 ~2QRQ  in  (2.16)  also  constrains  the  Hankel  norm 
of  the  approximation  error  Ey  when  Q  is  positive  definite.  To  show  this  let  P  €  IN”  be  the 


Q<  Q, 

and 

Bm,Cm)  <  J(Am>  BmyCm,  Q), 

where 

J(Am,Bm,Cm,Q)±  ttQR. 


6 


observability  Gramian  for  the  augmented  system  (A,  D;  E)  which  satisfies 


0  =  AtP  +  PA  +  R.  (2.25) 

Furthermore,  note  that  Q  satisfying  (2.13)  is  the  dual  controllability  Gramian. 

Proposition  2.2.  Let  ( Am,Bm,Cm )  be  given  and  assume  there  exists  Q  G  IPn  satisfying 
(2.16)  and  (2.17)  or,  equivalently,  (2.18).  Then 

A l^(PQ)  <  T  (2.26) 

Proof.  Since  Q  is  invertible,  (2.16)  implies 

0  =  ~i2AtQ~1  +i2Q-lA  +  'r2Q~iVQ-1  +  R.  (2.27) 

Next,  subtract  (2.25)  from  (2.27)  to  obtain 

0  =  At{'12Q~1  -P)  +  tfQ-1  -  P)A  +  ^Q-'VQ-1,  (2.28) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

-X-P  =  [°°  >  0.  (2.29) 

Jo 

Thus,  (2.29)  implies  P  <  72  Q~l  or,  equivalently,  <2^PQ$  <  ~t2ln.  Hence,  \m*x{PQ)  <  1-  Finally, 
(2.26)  follows  immediately  from  (2.20).  □ 

3.  The  Auxiliary  Minimization  Problem  and  Necessary  Conditions  for  Optimality 

As  discussed  in  the  previous  section,  the  replacement  of  (2.13)  by  (2.16)  enforces  the  H0 a 
approximation  constraint  between  the  full-  and  reduced-order  systems  and  results  in  an  upper 
bound  for  the  L%  model-reduction  criterion.  That  is,  if  (2.16)  is  solvable  then  the  reduced-order 
model  (Am,  Bm,Cm)  satisfies  the  !!„  approximation  constraint  (2.5)  while  the  actual  Li  model- 
reduction  criterion  is  guaranteed  to  be  no  worse  than  the  bound  given  by  J(Am,  Lm,Cm,  Q). 
Hence,  J(Am,  Bm,Cm,  Q)  can  be  interpreted  as  an  auxiliary  cost  which  leads  to  the  following 
mathematical  programming  problem. 

Auxiliary  Minimization  Problem.  Determine  ( Am,Bm,Cm,Q )  which  minimizes 
J(Am,flm,Cm,  Q)  subject  to  (2.15)  and  (2.16). 
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It  follows  from  Lemma  2.1  that  the  satisfaction  of  (2.15)-(2.17)  leads  to  1)  Am  stable;  2)  a 
bound  on  the  H distance  between  the  full-order  and  reduced-order  systems;  and  3)  an  upper 
bound  for  the  Xj  model-reduction  criterion.  Hence  it  remains  to  determine  (Am,  Bm,Cm)  which 
minimizes  J(Am,  Bm,Cm,  Q)  and  thus  provides  an  optimized  bound  for  the  actual  X2  criterion 
J(Am,  Bm,Cm).  Rigorous  derivation  of  the  necessary  conditions  for  the  Auxiliary  Minimization 
Problem  requires  additional  technical  assumptions.  Specifically,  we  restrict  (Am,  Q)  to 

the  open  set 

S  =  {(Am,5m,Cm,2)  :  Q.  €  IP",  A  +  ~f~2QR  is  asymptotically  stable, 

(3.1) 

and  (Am,  Bm,Cm)  is  controllable  and  observable}. 

Remark  3.1.  The  set  S  constitutes  sufficient  conditions  under  which  the  Lagrange  multiplier 
technique  is  applicable  to  the  Auxiliary  Minimization  Problem.  Specifically,  the  requirement  that 
5  be  positive  definite  replaces  (2.15)  by  an  open  set  constraint,  the  stability  of  A  +  i~2  QR  serves 
as  a  normality  condition,  and  (Am,  Bm,Cm)  minimal  is  a  nondegeneracy  condition. 

The  following  Lemma  is  needed  for  the  statement  of  the  main  result. 

Lemma  3.1.  Let  Q,P  €  IN”  and  suppose  rank  QP  =  nm.  T’  en  there  exist  nm  x  n  G,T 
and  nm  x  nm  invertible  M,  unique  except  for  a  change  of  basis  in  IR””,  such  that 

QP  =  GtMT,  (3.2) 


Furthermore,  the  n  x  n  matrices 


rcT  =  inm. 


r  ~  GtT, 
TX  =  In  ~T 


are  idempotent  and  have  rank  nm  and  n  -  nm,  respectively.  If,  in  addition, 


rank  Q  =  rank  P  =  nm, 


Q  =  tQ,  P  =  Pt. 


(3.7), (3.8) 


Finally,  if  P  €  INn  then  the  inverse 


(L  +  i-'QP)-1 
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exists. 


Proof.  Conditions  (3.2)-(3.8)  are  a  direct  consequence  of  Theorem  6.2.5  of  Rao  and  Mitra, 
1971.  To  prove  that  the  inverse  in  (3.9)  exists,  note  that  since  the  eigenvalues  of  QP  coincide  with 
the  eigenvalues  of  the  nonnegative-definite  matrix  P*QP*,  it  follows  that  QP  has  nonnegative 
eigenvalues.  Thus,  the  eigenvalues  of  In  +  1~2QP  are  all  greater  than  one  so  that  the  above  inverse 
exists.  □ 

Finally,  for  convenience  define 

Z  =  BVBt,  Z  =  CT  RC. 

Theorem  3.1.  If  (Am,  Q)  €  S  solves  the  Auxiliary  Minimization  Problem  then 


there  exist  Q,P,Q,P  €  IN"  such  that 

Am  =  r(A-i~*Q2QPS)GT,  (3.10) 

Bm  =  TS,  (3.11) 

Cm  =  C{In  +  1~2QPS)GT,  (3.12) 

[q  +  q 

fi“[rg  rqrT\  ’  (313) 

and  such  that  Q,P,Q,P  satisfy 

0  =  AQ  +  QAt  +  i~2QZQ  +  t±Zt±,  (3.14) 

0  =  AtP  +  PA  -  1-iSTPQZQPS  +  rJ(/„  +  ^QPS)7 Z{In  +  7 _JgPS)rx,  (3.15) 

0  =  (A  -  -t~AQZQPS)Q  +  g(A  -  ~i~aQ£QPS)t  +  7 ~aQStPQ£QPSQ  +  Z-  rx27rf,  (3.16) 
0  =  (A  +  7 ~2QZ)TP  +  P(A  +  7  ~2QZ)  +  {In  +  7  ~2QPS)TZ{In  +  7  ~*QPS) 

~  rliln  +  7 -*QPS)T£{In  +  7 ~2QPS)tx,  (3.17) 

rank  Q  =  rank  P  =  rank  QP  =  nm.  (318) 

Furthermore,  the  auxiliary  cost  is  given  by 

J{Am,  Bm,Cm,  Q)  =  tr  Z{Q  +  i~AQPSQST  PQ).  (3  19) 


Conversely,  if  there  exist  Q,P,Q,  P  €  IN"  satisfying  (3.14)-(3.18),  then  (Am,  Bm,Cm,  Q)  given  by 
(3.10)-(3.13)  satisfy  (2.15)  and  (2.16)  with  the  auxiliary  cost  (2.22)  given  by  (3.19). 


9 


Proof.  See  Appendix  A.  □ 


Remark  3.1.  Theorem  3.1  presents  necessary  conditions  for  the  Auxiliary  Minimization 
Problem  which  explicitly  synthesize  extremal  reduced-order  models  As  a  check 

of  these  conditions,  consider  the  extreme  case  nm  =  n.  Then  G  =  T~l  and  thus,  without  loss 
of  generality,  G  —  T  —  t  —  In  and  rj.  =  0.  Furthermore,  (3.14)  implies  that  Q  =  0  and  (3.15) 
implies  that  P  =  0.  Hence  the  Boo-constrained  full-order  model  is  given  (as  expected)  by  (A,  B,C) 
regardless  of  7.  Furthermore,  note  that  2  given  by  (3.13)  becomes 


2  = 


Q  Q 

A  A 

Q  Q 


(3.20) 


so  that  the  quadratic  term  7 -,2R2  in  (2.16)  vanishes.  Thus  (2.16)  reduces  to  (2.13)  so  that 
2  coincides  with  the  controllability  Gramian  Q.  If,  alternatively,  the  reduced-order  constraint 
is  retained  but  the  transfer  function  approximation  constraint  (2.5)  is  sufficiently  relaxed,  i.e., 
7  — »  00,  then  S  =  In  so  that  the  reduced-order  model  (3.10)-(3.12)  is  given  by  (Am,  Bm,Cm)  ~ 
(r AGt ,  T B ,CGt) .  In  this  case  (3.14)  and  (3.15)  are  superfluous  and  (3.16)  and  (3.17)  reduce  to 
the  optimal  projection  equations  obtained  by  Hyland  and  Bernstein,  1985,  for  the  unconstrained 
Lj  problem. 


4.  Sufficient  Conditions  for  Combined  L3/H00  Approximation 

In  this  section  we  combine  Lemma  2.1  with  the  converse  of  Theorem  3.1  to  obtain  our  mam 
result  guaranteeing  constrained  Hoa  approximation  along  with  an  optimized  Lj  model-reduction 
bound. 

Theorem  4.1.  Suppose  there  exist  Q,P,Q,P  €  IN'*  satisfying  (3. 14)— (3. 18)  and  let 
(Am,Bm,Cm,  2)  be  given  by  (3.10)-(3.13).  Then  (A,  [7“*2B2  +V)i)  is  stabilizable  if  and  only 
if  Am  is  asymptotically  stable.  In  this  case,  the  reduced-order  transfer  function  Bm(s)  satisfies  the 
Boo  approximation  constraint 

|IB(.)-Bm(e)||oo<7  (41) 

and  the  £3  approximation  bound 

II B (a)  -  Bm(.)||,  <  [  tr  £{Q  +  ^QPSQS7 PQ)\  * .  (4.2) 


Proof.  The  converse  portion  of  Theorem  3.1  implies  that  2  given  by  (3.13)  satisfies  (2.15)  and 
(2.16)  with  auxiliary  cost  given  by  (3.19).  It  now  follows  from  Lemma  2.1  that  the  stabilizability 
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condition  (2.17)  is  equivalent  to  the  asymptotic  stability  of  Am,  the  Hoo  approximation  condition 
(2.19)  holds,  and  the  Li  model- reduction  criterion  satisfies  the  bound  (2.21)  which  is  equivalent  to 
(4.2).  □ 

In  applying  Theorem  4.1  the  principal  issue  concerns  conditions  on  the  problem  data  under 
which  the  coupled  Riccati  equations  (3.14)-(3.17)  possess  nonnegative-definite  solutions.  Clearly, 
for  7  sufficiently  large,  (3.14)-(3.17)  approximate  the  ‘pure*  Li  solution  obtained  in  Hyland  and 
Bernstein,  1985.  In  practice,  we  would  numerically  solve  (3.14)-(3.1?)  for  successively  smaller  values 
of  7  until  solutions  are  no  longer  obtainable.  The  important  case  of  interest,  however,  involves  small 
7  so  that  accurate  Hgo  approximation  is  enforced.  Thus,  if  (4.1)  can  be  satisfied  for  a  given  7  >  0 
by  a  class  of  reduced-order  models,  it  is  of  interest  to  know  whether  one  such  reduced-order  mode) 
can  be  obtained  by  solving  (3.14)-(3.17).  Lemma  2.2  guarantees  that  (2.16)  possesses  a  solution 
for  any  model  satisfying  (4.1).  Thus  our  sufficient  conditions  will  also  be  necessary  so  long  as  the 
Auxiliary  Minimization  Problem  possesses  at  least  one  extremal  over  S.  When  this  is  the  case  we 
have  the  following  immediate  result. 

Proposition  4.1.  Let  7*  denote  the  infimum  of  ||/f(s)  -  fifm(s)j|a«,  over  all  asymptotically 
stable  reduced-order  models  and  suppose  that  the  Auxiliary  Minimixation  Problem  has  a  solution 
for  all  7  >  7*.  Then  for  all  7  >  7*  there  exist  Q,P,<5,^€  IN’*  satisfying  (3. 14)— <3.17). 

Remark  4.1.  As  in  Hyland  and  Bernstein,  1985,  it  can  be  expected  that  (3. 14)— (3. 17)  possets 
multiple  solutions.  Theorem  4.1  guarantees,  however,  that  the  bounds  (4  1)  and  (4.2)  are  enforced 
for  all  such  extremals  obtained  by  solving  (3. 14}— <3. 17) . 


Appendix  A:  Proof  of  Theorem  3.1 


To  optimize  (2.22)  over  the  open  aet  5  subject  to  the  constraint  (2.16),  form  the  Lagrangian 
£(Am,Bm,Cm,Q,P,X )4  tr{Afl*+[Afi  +  QAT^^-tQRQ^V\P},  (A.I) 
where  the  Lagrange  multipliers  A  >  0  and  P  €  IR"X*  are  not  both  zero.  We  thus  obtain 

=  (A  +  1-*QR)TP  +  P(A  +  7-*fitf)  +  XR.  (A. 2) 

Setting  =  0  yields 

0  =  (A  +  i-*QR)tP  +  P(A  +  i-'QR)  +  A*.  (A. 3) 

Since  A  +  7_1 is  assumed  to  be  stable,  A  =  0  implies  P  =  0.  Hence,  it  can  be  assumed  without 
loss  of  generality  that  A  =  1.  Furthermore,  P  is  nonnegative  definite. 


Now  partition  h  x  h  Q,P,  into  n  x  n, n  x  ru»,  and  %,  x  n«  subblodts  as 

Qi  Qit 
>r 
‘u 

and  for  notational  convenience  define 


Q  = 


Ql *  Q> 


p  = 


Pi  Pn 
P?>  P i 


where 


Zu 

Z,  ' 


Thus,  with  A  =  1  the 

ar 

dQ 


dC 

dAm 

d£ 

dBm 


dC 

dCm 


=  PiQi  +  Pij<?f„  Z„4  PiQu  +  PnQ,, 
Zn  =  Pl7Qi  +  PiQl „  Z7  4  pTqu  + 

stationarity  conditions  are  given  by 

=  (A  +  7-,QH)rP  +  P(A  +  7",CH)  +  H  =  0, 


=  Zt  =  0, 

=  PXiBV  +  P,BmV  =  0, 

=  2RCmQ7  +  27-*f?CmZ1T,Qi,  -  2i?CQx,  -  7 -'RCZfQu 
-  i-'RCQiZu  -  7~* =  0. 


(A.4) 

(A.5) 


(A.6) 


(A.7) 
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Expanding  (2.16)  and  (A.4)  yields 

0  =  AQ1  +  QXAT  +  l~\QiCT  -  QnCl)R(QiCT  -  QltCl)T  +  BV BT ,  (A.8) 

0  =  AQxt  +  QXiAl  +  RCQxi  -  i~'QnCZRCQlt  -  n~'QxCT RCmQt 

+  l-iQuClRCmQi,  (A  9) 

0  =  A^,  +  Q,Al  +  'f~t(QXjCT  -  QjCDRiQ^C7  -  QtCZ)T  +  BmVBl,  (A.10) 

0  =  AtPx  +  PXA  +  i-*CtRCZ?  -  7",CT/?Cm2lT |  +  i-'Z^RC 

r*ZXiClRC  +  CTRC ,  (All) 

0  =  ATPxi  +  PiaAm  +  i~3CT RCZZ  -  T* ZxCtRC m  PCm  -  CrPCm,  (A.12) 

0  =  A^P,  +  P,Am  -  i-’clRCZl,  -  'i~iZuCT RCm  +  Cl*Cm.  (A.13) 


Now  define  the  n  x  n  matrices 

<?  =  <?!-  QuQr^f,,  p  =  p,  -  PuPf ‘p,7,. 

g^giaQr'gr,,  /^p.jp^p7, 

r  =  -QXiQxlPrlpxi, 

and  the  nm  x  n,nm  x  nm  and  nm  x  n  matrices 

G  =  Q;lQu,  M^QiPi,  r  =  -PilP?,. 

The  existence  of  Qf 1  and  P,-1  follows  from  the  fact  that  (Am,  Bm,Cm)  is  minimal.  See  Bernstein 
and  Haddad,  1988,  and  Hyland  and  Bernstein,  1985,  for  details.  Note  that  r  =  CT T.  Clearly, 
Q,P,Q,  and  P  are  symmetric  and  nonnegative  definite. 

Next  note  that  with  the  above  definitions,  (A. 5)  implies  (3.3)  and  that  (3.2)  holds.  Hence 
r  =  Gt r  is  idempotent,  i.e.,  r*  =  r.  Sylvester’s  inequality  yields  (3.18).  Note  also  that  (3.7)  and 
(3.8)  hold. 

The  components  of  Q  and  P  can  be  written  in  terms  of  Q,P,Q,P,G,  and  f  as 


Qx  —  Q  +  Q>  Px  —  P+P, 

(A.  14) 

Qi2  =  QrT,  pX2  =  -Pgt, 

(A.15) 

Qi  =  rgrT,  p,  =  gpgt. 

(A.  16) 
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Next  note  that  by  using  (A.14)-(A.16),  (A.7)  becomes 

CmS  =  C[ln  +  +  Q)P]GT, 

where 

S±Inm+i~'rQPGT. 

To  prove  that  5  is  invertible  use  (3.7)  and  (3.4)  and  note  that 

+i~,rqPGT  =  +1-irQrTpcT 

=  inm+i~\rQrT){GPGT). 

Since  rQTT  and  GPGT  are  nonnegative  definite,  their  product  has  nonnegative  eigenvalues.  Thus 
each  eigenvalue  of  /„m  +*i~2 TQPGT  is  real  and  is  greater  than  unity.  Hence  S  is  invertible.  Now 
note  that  by  using  (3.3)  and  (3.4)  it  can  be  shown  that 

GT§~lr  =  Sr. 


The  expressions  (3.11),  (3.12)  and  (3.13)  follow  from  (A.6),  (A.7),  (3.9)  and  the  definition  of  Q 
by  using  the  above  identities.  Next,  computing  either  r(A.9)-(A.10)  or  G(A.12)+(A.13)  yields 
(3.10).  Substituting  this  expression  for  Am  into  (A.8)-(A.13)  it  follows  that  (A.  10)  =  r{ A.9)  and 
(A.13)  =  G(A.12).  Thus,  (A.10)  and  (A.13)  are  superfluous  and  can  be  omitted.  Next,  using 
(A.8)+GTr(A.9)G  -  (A.9)G  -  [(A.9)G]T  and  Grf(A.9)G  -  (A.9)G  -  [(A.9)G]T  yields  (3.14) 
and  (3.16).  Using  (A.ll)  +  TTG(A.12)r  -  (A.12)T  -  [(A.12)r]T  and  frG(A.12)r  -  (A.12)f  - 
[(A.12)r]T  yields  (3.15)  and  (3.17). 


Finally,  to  prove  the  converse  we  use  (3.10)-(3.18)  to  obtain  (2.16)  and  (A.4)-(A.7).  Let 
Am,Bm,Cm,G,  r,r,Q,P,Q,P,  Q  be  as  in  the  statement  of  Theorem  3.1  and  define  Qi,Qi2,Q2, 
Puf>i2,Pi  by  (A.14)-(A.16).  Using  (3.3),  (3.11)  and  (3.12)  it  is  easy  to  verify  (A.6)  and  (A.7). 
Finally,  substitute  the  definitions  of  Q,P,Q,P,G,r,  and  r  into  (3.14)-(3.17)  along  with  (3.3), 
(3.4),  (3.7)  and  (3.8)  to  obtain  (2.16)  and  (A. 4).  Finally,  note  that 


Q  = 

which  shows  that  Q  >  0.  □ 


Q 

Onxn* 

+ 

'/«' 

.0nmxn 

r 

Q[in  rT ], 
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Abstract 

An  estimator  design  problem  is  considered  which  involves  both  Lj  (least  squares)  and 
(worst-case  frequency-domain)  aspects.  Specifically,  the  goal  of  the  problem  is  to  minimize  an  Li 
state-estimation  error  criterion  subject  to  a  prespecified  H «  constraint  on  the  state-estimation  er¬ 
ror.  The  Hoo  estimation-error  constraint  is  embedded  within  the  optimization  process  by  replacing 
the  covariance  Lyapunov  equation  by  a  Riccati  equation  whose  solution  leads  to  an  upper  bound 
on  the  Li  state-estimation  error.  The  principal  result  is  a  sufficient  condition  for  characterizing 
fixed-order  (i.e.,  full-  and  reduced-order)  estimators  with  bounded  Lj  and  estimation  error. 
The  sufficient  condition  involves  a  system  of  modified  Riccati  equations  coupled  by  an  oblique 
projection,  i.e.,  idempotent  matrix.  When  the  constraint  is  absent,  the  sufficient  condition 
specializes  to  the  Li  state-estimation  result  given  in  [2j. 


Keywords:  Kalman  filter,  Hoo  norm,  reduced-order  state  estimation,  optimal  projection  equa¬ 
tions,  Hankel  norm. 
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1.  Introduction 


One  of  the  fundamental  problems  in  dynamic  systems  theory  is  the  observation  of  state  vari¬ 
ables.  Although  an  extensive  theoretical  foundation  has  been  developed  for  the  quadratic  (least 
squares)  error  criterion,  state  estimation  with  a  worst-case  frequency-domain  design  objective  has 
apparently  not  been  considered.  In  the  present  paper  we  thus  extend  the  least  squares  formulation 
to  include  a  frequency-domain  bound  on  the  state-estimation  error.  The  underlying  idea  involves 
the  application  of  state-space  techniques  which  have  recently  been  developed  for  control  design 
in  [1,4-6].  The  results  of  the  present  paper  are  thus  complementary  to  the  results  obtained  in  [l] . 

The  principal  result  of  the  present  paper  is  a  sufficient  condition  which  yields  full-  and  reduced- 
order  estimators  satisfying  an  optimized  Li  error  bound  as  well  as  a  prespecified  error  bound. 
In  the  full-order  case,  the  Hoo-constrained  estimator  involves  a  modified  Riccati  equation  which 
specializes  to  the  standard  steady-state  Kalman  filter  when  the  constraint  is  absent.  In  the 
reduced-order  case  the  .Hoo-constrained  result  leads  to  a  direct  generalization  of  the  optimal  pro¬ 
jection  approach  developed  in  [2]  for  the  unconstrained  Li  state-estimation  problem.  While  the 
Z-2-optimal  reduced-order  state  estimator  was  characterized  in  [2]  by  means  of  a  coupled  system  of 
one  modified  Riccati  equation  and  two  modified  Lyapunov  equations,  the  Jfoo-constrained  solution 
involves  a  coupled  system  consisting  of  three  modified  Riccati  equations  and  one  modified  Lya¬ 
punov  equation.  As  in  [2],  the  coupling  is  due  to  the  presence  of  an  oblique  projection  (idempotent 
matrix)  with  additional  coupling  now  arising  from  the  constraint.  When  the  constraint  is 
sufficiently  relaxed,  these  conditions  again  specialize  directly  to  those  given  in  [2]. 

We  note  that  the  development  in  the  present  paper  is  limited  to  the  case  in  which  the  plant 
is  asymptotically  stable.  These  results  can  also  be  extended  to  the  unstable  plant  case,  although 
with  additional  complexity.  This  case  will  thus  be  treated  in  a  future  paper. 

The  contents  of  the  paper  are  as  follows.  After  collecting  notation  in  Section  2,  the  statement 
of  the  ffoo -Constrained  State- Estimation  Problem  is  given  in  Section  3.  The  principal  result  of  this 
section  (Lemma  3.1)  shows  that  if  the  algebraic  Lyapunov  equation  for  the  covariance  is  replaced 
by  a  modified  Riccati  equation  possessing  a  nonnegative-definite  solution,  then  the  estimation- 
error  constraint  is  enforced  and  the  Li  state-estimation  error  criterion  is  bounded  above  by  an 
auxiliary  cost  function.  The  problem  of  determining  a  reduced-order  estimator  which  minimizes 
this  upper  bound  subject  to  the  Riccati  equation  constraint  is  considered  in  Section  4  as  the 
Auxiliary  Minimization  Problem.  Necessary  conditions  for  the  Auxiliary  Minimization  Problem 
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(Theorem  4.1)  are  given  in  the  form  of  a  coupled  system  of  modified  algebraic  Riccati  equations. 
To  develop  connections  with  standard  Kalman  filter  theory  the  full-order  estimator  result  is  also 
given.  In  Section  5  the  necessary  conditions  of  Theorem  4.1  are  combined  with  Lemma  3.1  to  yield 
sufficient  conditions  for  bounded  Hoo  and  L2  estimation  error.  Although  our  result  gives  sufficient 
conditions  for  Hoo  estimation  error,  we  also  state  hypotheses  under  which  these  conditions  are  also 
necessary  (Proposition  5.1). 


2.  Notation  and  Definitions 

IR,  IRrx*,IRr,IE  real  numbers,  r  x  s  real  matrices,  IRrXl,  expected  value 

Ir,(  )T,0rx»»0r  r  x  r  identity  matrix,  transpose,  r  x  s  zero  matrix,  0rX r 

tr  trace 


<rm*x(Z) 

Am**(2) 

II*IIf 

IlffWIleo 

Sr,INr,IPr 

Z\  <  Zj,  Z\  <  Zj 

n,t,ne,p,q,r;h 

x,y,ye,xt,x 

x 

A,C 

Di>  D2,  E 
L 

A* ,  Be ,  Ce 
A 

D,E 

R 

w(-) 

VuVt 


largest  singular  value  of  matrix  Z 
largest  eigenvalue  of  matrix  Z  with  real  spectrum 
[tr  ZZ7}^  (Frobenius  matrix  norm) 
supu6iRffm*x[ff(.7w)] 

r  x  r  symmetric,  nonnegative-definite,  positive-definite  matrices 
Z2  -  Zx  €  INr,  Z2  -  Zx  €  IPr,  Zu  Z2  €  Sr 
positive  integers;  n  +  n,;ne  <  n 
n,t,q,  ne,n-dimensionaI  vectors 


n  x  n,l  x  n  matrices 
n  x  p,£  x  p,r  x  q  matrices 
q  x  n  matrix 


ne  x  ne,ne  x  £,q  x  nt  matrices 
A  0„  x  n« 

.BgC  At 


B% J  '  1“  "£C-I 

EtE,  estimation  error  weighting  in  IP‘? 


p-dimensional  standard  white  noise  process 

intensity  of  D1u/(.),.Djtt/(-);  Vx  =  DxDj  eNn  ,V2  =  D2Dj  €  JPC 
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Vl2 

R,V 
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cross  intensity  of  Diu>{-),  D2w(-)] 
LrRL  -LtRCA 
-CJRL  CjRCt  ’ 
positive  constant 


V12  =  DiDj  €  IRnx4 
Vi  V12BJ  ' 

B'V£  BtV2Bj_ 


3.  Statement  of  the  Problem 

In  this  section  we  introduce  the  reduced-order  state-estimation  problem  with  a  constraint  on 
the  Hoo  norm  of  the  state-estimation  error.  Specifically,  the  transfer  function  between  disturbances 
and  error  states  is  constrained  to  have  H <*,  norm  less  than  7.  In  this  paper  it  is  assumed  that  the 
plant  is  asymptotically  stable,  i.e.,  the  eigenvalues  of  A  are  in  the  open  left  half  plane. 

Hoo- Constrained  State-Estimation  Problem.  Given  the  nth-order  observed  system 

x(t )  =  Ax(t )  +  Diw(t),  (3.1) 

y(t)  =  Cx(t)  +  D2w(t),  (3.2) 

where  t  €.  [0,oo),  determine  an  neth-order  state  estimator 

xe(i)  =  Aexe{t)  +  Bey(t),  (3.3) 

y*(t)  =  Cexe(t),  (3.4) 

where  ne  <  n,  which  satisfies  the  following  design  criteria: 

(i)  At  is  asymptotically  stable; 

(ii)  the  r  x  p  transfer  function 

H{s)  =  E[slfi-  A)-lD  (3.5) 

from  disturbances  w{t)  to  error  states  E[Lx(t )  -  ye{t)\  =  Ex(t)  satisfies  the 
constraint. 

IlffOOlioo  <  7>  (3.6) 

where  7  >  0  is  a  given  constant;  and 

(iii)  the  L2  state-estimation  error  criterion 

J(A',Bt,Ce)  4  tUm  TE[{Lx{t)  -  ye(t)]T R[Lx(t)  -  ye(t)]}  (3.7) 
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is  minimized. 


It  is  useful  to  note  that  the  augmented  system  (3.1)-(3.4)  can  be  written  as 

x(t)  =  Ax(t)  +  Dw(t),  t  €  [0,oo), 


(3.8) 


and  that  (3.7)  is  equivalent  to 

J(Ae,Be,Ce)  =  Jim  IE{[if(f)]T[^i(0]}  =  Hm  m[xT(t)Rx(t)] .  (3.9) 

Furthermore,  if  At  is  asymptotically  stable  for  a  given  estimator  (Ae,  Be,Ce)  then  the  Li  state- 
estimation  error  criterion  is  given  by 


J{As,Be,C,)  —  tr  QR, 


(3.10) 


where  the  steady-state  covariance  defined  by 

Q  =  ^lim  IE[5(t)xT(t)] 
satisfies  the  n  X  n  Lyapunov  equation 

0  =  AQ  +  QAt+  V. 


(3.11) 


(3.12) 


Using  (3.10)  and  (3.12)  we  now  show  that  the  criterion  (3.7)  is  an  error  measure  involving  the 
impulse  response  of  (3.8)  with  respect  to  an  Li  norm. 


Proposition  3.1.  If  At  is  asymptotically  stable  then  the  Li  state-estimation  error  criterion 
(3.7)  can  be  written  as 

J(Ae,B',Ct)=  r  \\Ee^b\\\dt.  (3.13) 

Jo 


Proof.  It  need  only  be  noted  that  (3.10)  is  equivalent  to 

tr  e*tVe*TtdtR  =  tr  /°° [EeXt D){EeAt b)Tdt, 

Jo  Jo 

which  is  equivalent  to  (3.13).  □ 

The  key  step  in  enforcing  (3.6)  is  to  replace  the  algebraic  Lyapunov  equation  (3.12)  by  an 
algebraic  Riccati  equation.  Justification  for  this  technique  is  provided  by  the  following  result. 
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Lemma  3.1.  Let  (Ae,  Be,Ce)  be  given  and  assume  there  exists  Q  e  IRnXn  satisfying 


Q  €  IN” 

(3.14) 

and 

0  =  A<2  +  QAT  +  'f~2QRQ  +  V. 

(3.15) 

Then 

(A,  [i~2  Q.RQ.  +  V]’)  is  stabilizable 

(3.16) 

if  and  only  if 

Ae  is  asymptotically  stable. 

(3.17) 

Furthermore,  in  this  case 

IlffMIloo  <Tf, 

(3.18) 

Q<Q, 

(3.19) 

and 

J{Ae,Bt,Ct)<  J{A„B.,C.,Q), 

(3.20) 

where 

J[Ae,  Be,Ce,  Q)  =  tr  QR. 

(3.21) 

Proof.  Using  the  assumed  existence  a  nonnegaHve-definite  solution  to  (3.15)  and  the  stabi- 
lizability  condition  (3.16),  it  follows  from  the  dual  of  Lemma  12.2  of  [9]  that  A  is  asymptotically 
stable.  Since  A  is  lower  block  triangular,  A  asymptotically  stable  implies  Ae  is  asymptotically  sta¬ 
ble.  Conversely,  since  A  is  assumed  to  be  asymptotically  stable,  (3.17)  implies  A  is  asymptotically 
stable  and  thus  (3.16)  holds.  The  proof  of  (3.18)  follows  from  a  standard  manipulation  of  (3.15); 
for  details  see  Lemma  1  of  [8],  To  prove  (3.19)  subtract  (3.12)  from  (3.15)  to  obtain 

0  =  A(<2  -Q)  +  (fl  -Q)At  +  1~2QRQ,  (3.22) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

Q-Q  =  f  eAt['i'2QRQ]eA'ttdt  >  0.  (3.23) 

Jo 

Finally,  (3.20)  follows  immediately  from  (3.19).  □ 
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Lemma  3.1  shows  that  the  Hqq  constraint  is  automatically  enforced  when  a  nonnegative-definite 
solution  to  (3.15)  can  be  shown  to  exist.  Furthermore,  the  solution  Q  provides  an  upper  bound  for 
the  steady-state  covariance  Q  along  with  a  bound  on  the  L%  state-estimation  error  criterion.  Noxt, 
we  present  a  partial  converse  of  Lemma  3.1  which  guarantees  the  existence  of  a  nonnegative-definite 
solution  to  (3.15)  when  (3.18)  is  satisfied. 

Lemma  3.2.  Let  (Ae,  Bt,Ce)  be  given,  suppose  At  is  asymptotically  stable,  and  assume  the 
Hqo  state-estimation  error  constraint  (3.18)  is  satisfied.  Then  there  exists  a  unique  nonnegative- 
definite  solution  <2  satisfying  (3.15).  Furthermore,  (A  +  i~2QR,D)  is  stabilizable  if  and  only  if 
A  +  7 ~2QR  is  asymptotically  stable. 

Proof.  The  result  is  an  immediate  consequence  of  Theorems  3  and  2  of  [3],  pp.  150  and  167, 
along  with  the  dual  of  Lemma  12.2  of  [9].  □ 

Finally,  we  show  that  the  quadratic  term  i~2QRQ  in  (3.15)  also  constrains  the  Hankel  norm 
of  the  estimation  error  E\Lx{t )  —  y*(t)]  when  <2  is  positive  definite.  To  show  this  let  P  6  INn  be 
the  observability  G  rami  an  for  the  augmented  system  (A,  D,E)  which  satisfies 


0  =  AtP  +  PA  +  R.  (3.24) 

Proposition  3.2.  Let  ( At,Be,Ca )  be  given  and  assume  there  exists  Q  €  BP"  satisfying  (3.15) 
and  (3.16)  or,  equivalently,  (3.17).  Then 

A Lx(PQ)  <  7-  (3.25) 

Proof.  Since  Q  is  invertible,  (3.15)  implies 

0  =  7*  At<2-1  +  7  7Q~lA  +  ^2  Q~1V  Q~1  +  R.  (3.26) 

Next,  subtract  (3.24)  from  (3.26)  to  obtain 

0  =  -  P)  +  (7 1<2~1  -  P)A  +  7 2Q-1VQ-\  (3.27) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

7 2fi-1  -  P=  f  e*P*[7a Q~lV Q-^e^dt  >  0.  (3.28) 

Jo 
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Thus  (3.28)  implies  P  <  722  1  or,  equivalently,  Q*PQ*  <  7 2 la.  Hence, 

>  Affl,*(2 >PQX*)  =  Amax(P*  flP*)  >  Amax(p*gp*)  =  Amax(PQ).  □ 

4.  The  Auxiliary  Minimization  Problem  and  Necessary  Conditions  for  Optimality 

As  discussed  in  the  previous  section,  the  replacement  of  (3.12)  by  (3.15)  enforces  the 
state-estimation  error  constraint  and  results  in  an  upper  bound  for  the  L2  state-estimation  error 
criterion.  That  is,  given  an  estimator  ( Ae,Be,Ce )  satisfying  the  estimation  constraint,  the 
actual  Lj  state-estimation  error  criterion  is  guaranteed  to  be  no  worse  than  the  bound  given  by 
J(Ae,Bt,Ce,  Q)  if  (3.15)  is  solvable.  Hence,  J(At,  Bt,Cet  Q)  can  be  interpreted  as  an  auxiliary 
coat  which  leads  to  the  following  optimization  problem. 

Auxiliary  Minimization  Problem.  Determine  (Ae,  Be,Ce,  Q)  which  minimizes  J(Ae,Be, 
Ce,  2)  subject  to  (3.14)  and  (3.15). 

It  follows  from  Lemma  3.1  that  the  satisfaction  of  (3.14)-(3.16)  leads  to  1)  A„  stable;  2)  Hx 
estimation  error  bound  7;  and  3)  an  upper  bound  (3.21)  for  the  L2  state-estimation  error  criterion. 
Hence  it  remains  to  determine  (At,Bt,Ct)  which  minimizes  J{At,  Be,Ce,  2)  and  thus  provides 
an  optimized  bound  for  the  actual  L2  criterion  J(At,  Be,Ce).  Rigorous  derivation  of  the  neces¬ 
sary  conditions  for  the  Auxiliary  Minimization  Problem  requires  additional  technical  assumptions. 
Specifically,  we  restrict  ( Ae,Be,Ct ,  2)  to  the  open  set 

S  =  {(A«,  Be,Ce,  2)  :  Q  E  IP",  A  +  7 ~3  QR  is  asymptotically  stable, 
and  (Ae,  Bt,Ce)  is  controllable  and  observable}. 

Remark  4.1.  The  set  S  constitutes  sufficient  conditions  under  which  the  Lagrange  multiplier 
technique  is  applicable  to  the  Auxiliary  Minimization  Problem.  Specifically,  the  requirement  that 
2  be  positive  definite  replaces  (3.14)  by  an  open  set  constraint,  the  stability  of  A  +  7~22i?  serves 
as  a  normality  condition,  and  (A,,  B,,Ct)  minimal  is  a  nondegeneracy  condition. 

The  following  Lemma  is  needed  for  the  statement  of  the  main  result. 

Lemma  4.1.  Let  Q,P  €  IN"  and  suppose  rank  QP  =  n,.  Then  there  exist  ne  x  n  G ,  T  and 
n,  X  n,  invertible  M,  unique  except  for  a  change  of  basis  in  1R"* ,  such  that 

QP  =  GtMT,  (4.1) 
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(4.2) 


rGT  =  /„.. 

Furthermore,  the  n  x  n  matrices 

r  =  GtF,  (4.3) 

r±  =  In-r,  (4.4) 

are  idempotent  and  have  rank  ne  and  n  -  ne,  respectively.  If,  in  addition, 

rank  Q  =  rank  P  =  ne,  (4.5) 

then 

Q  =  rQ,  P  =  Pt.  (4-6),  (4.7) 

Finally,  if  P  €  IN”  then  the  inverse 

S^iln+i-'QP)-1  (4.8) 

exists. 

Proof.  Conditions  (4.1)-(4.7)  are  a  direct  consequence  of  Theorem  6.2.5  of  [7],  To  prove  that 
the  inverse  in  (4.8)  exists,  note  that  since  the  eigenvalues  of  QP  coincide  with  the  eigenvalues  of 
the  nonnegative-definite  matrix  P^QPi,  it  follows  that  QP  has  nonnegative  eigenvalues.  Thus, 
the  eigenvalues  of  /„  -f  7 ~*QP  are  all  greater  than  one  so  that  the  above  inverse  exists.  □ 

Finally,  for  arbitrary  Q  €  IRnxn  define  the  notation 

Qa  =  QCT  +  Vx 2 ,  27  4  LtRL.  (4.9) 

Theorem  4.1.  If  Q)  €  S  solves  the  Auxiliary  Minimization  Problem  then  there 

exist  Q,P,Q,P  €  INn  such  that 


A ,  =  r(A  -  QaVf'C  -  7 -*QEQPS)Gt, 

(4.10) 

Bt  =  rQ.Vf1, 

(4.11) 

Ct  =  L{In  +  'j-2QPS)GTi 

(4.12) 

+  Q  Qrr' 
rQ  rQr T  ’ 

(4.13) 
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and  such  that  Q,P,Q,P  satisfy 


0  =  AQ  +  QAt  +  Vi  +  7  ~*QZQ  -  QaVf'Qj  +  rxQaVflQjrJ,  (4.14) 

0  =  AtP+  PA  -  7 ~4SrPQZQPS  +  rj(/n  +  ~t-*QPS)T2(In  +  7~2QPS)rx,  (4.15) 

0  =  (A  -  7 ~*QSQPS)Q  +  Q{A  -  7 ~*QZQPS)T  +  7-  4QSTPQZQPSQ 

+  QaVf1Q^-rJLQaVf1Qjrl  ~  (4.16) 

0  =  (A  -  QaVf'C  +  7 -2QX)tP  +  P[A  -  QaVflC  +  7  ~2QZ) 

+  {In  +  7 -2QPS)r£(In  +  i~2QPS)  -  rJ(Jn  +  7 -JgPS)Tr(/n  Hr  7 ~*QPS)tx,  (4.17) 

rank  Q  —  rank  P  =  rank  QP  =  ne.  (4-18) 

Furthermore,  the  auxiliary  cost  is  given  by 

J{A',Be,Ce,Q )  =  tr  LtRL(Q  +  '}~4QPSQStPQ).  (4.19) 


Conversely,  if  there  exist  Q,P,Q,P  £  IN'*  satisfying  (4.14)-(4.18),  then  (Ae,  Be,Cc,  Q)  given  by 
(4.10)-(4.13)  satisfies  (3.14)  and  (3.15)  with  the  auxiliary  cost  (3.21)  given  by  (4.19). 

Proof.  See  Appendix  A.  □ 

Remark  4.2.  Theorem  4.1  presents  necessary  conditions  for  the  Auxiliary  Minimization  Prob¬ 
lem  which  explicitly  synthesize  extremal  full-  and  reduced-order  estimators  (A„,  Be,Ce).  If  the  Hoo 
estimation  constraint  is  sufficiently  relaxed,  i.e.,  7  — ►  00,  then  S  =  In  this  case  equations  (4.16) 
and  (4.17)  become  decoupled  from  (4.15)  and  thus  (4.15)  becomes  superfluous.  Furthermore,  (4.14), 
(4.16)  and  (4.17)  specialize  to  the  optimal  projection  equations  obtained  in  [2]. 

As  discussed  in  [2],  in  the  full-order  (Kalman  Filter)  case  ne  =  n,  G  =  .T-1  and  thus  G  =  T  = 
t  —  In  and  r_L  =  0  without  loss  of  generality.  To  develop  further  connections  with  the  standard 
Kalman  filter  theory  assume 

Vxt  =  0.  (4.20) 

In  this  case  (4.15)  implies  that  P  =  0  so  that  the  gain  expressions  (4.10)-(4.12)  become 

At  =  A-  QCTV3-lC, 

B,  =  QCV,-1, 

C,  =  L, 
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(4.21) 

(4.22) 

(4.23) 


while  equations  .(4.14)-(4. 16)  and  auxiliary  cost  (4.19)  specialize  to 

0  =  AQ  +  QAr  +  Vx  +  i-'QtfRLQ  -  QC^V^CQ,  (4.24) 

JiA',Bt,C',Q)=  tr  LtRLQ.  (4.25) 

Remark  4.3.  Note  that  the  necessary  conditions  for  the  full-order  problem  involve  one  modi¬ 
fied  Riccati  equation.  This  equation  is  similar  to  the  observer  Riccati  equation  with  the  additional 
quadratic  term  'j~iQLTRLQ.  Finally,  note  that  when  the  Hoc  estimation  constraint  is  sufficiently 
relaxed,  i.e.,  7  — »  00,  (4.24)  reduces  to  the  standard  observer  Riccati  equation  of  steady-state 
Kalman  filter  theory. 

5.  Sufficient  Conditions  for  Combined  Lj/Hm  Estimation 

In  this  section  we  combine  Lemma  3.1  with  the  converse  of  Theorem  4.1  to  obtain  our  main 
result  guaranteeing  constrained  Hoo  state-estimation  error  and  an  optimized  Lz  state-estimation 
error  bound. 

Theorem  5.1.  Suppose  there  exist  Q,P,Q,P  6  IN"  satisfying  (4.14)-(4.18)  and  let  ( Ae,Be , 
C„Q)  be  given  by  (4.10)-(4.13).  Then  (A,  [7-*  QRQ.  +  V]i)  is  stabilizable  if  and  only  if  Ae  is 
asymptotically  stable.  In  this  case,  the  transfer  function  H[s)  defined  by  (3.5)  satisfies  the 
state-estimation  error  constraint 

II# (s)lloo  <  7,  (5.1) 

and  the  Lj  state-estimation  error  criterion  (3.7)  satisfies  the  bound 

J(A«,B„C€)<  tr  LTRL(Q  +  1-*QPSQSrPQ).  (5.2) 

Proof.  The  converse  portion  of  Theorem  4.1  implies  that  Q  given  by  (4.13)  satisfies  (3.14) 
and  (3.15).  It  now  follows  from  Lemma  3.1  that  the  stabilizability  condition  (3.16)  is  equivalent 
to  the  asymptotic  stability  of  A,,  the  Hgo  state-estimation  error  constraint  (3.18)  holds,  and  the 
l\  state-estimation  error  criterion  (3.7)  satisfies  the  bound  (3.20)  which,  by  (4.19),  is  equivalent 
to  (5.2).  □ 

In  applying  Theorem  5.1  the  principal  issue  concerns  conditions  on  the  problem  data  under 
which  the  coupled  Riccati  equations  (4.14)-(4.17)  possess  nonnegative-definite  solutions.  Clearly, 
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for  7  sufficiently  large,  (4.14)-(4.17)  approximate  the  pure  least  squares  problem  considered  in 
[2],  The  important  case  of  interest,  however,  involves  small  7  so  that  significant  estimation 
is  enforced.  Thus,  if  (5.1)  can  be  satisfied  for  a  given  7  >  0,  it  is  of  interest  to  know  whether 
one  such  fixed-order  estimator  can  be  obtained  by  solving  (4.14)-(4.17).  Lemma  3.2  guarantees 
that  (3.15)  possesses  a  solution  for  any  fixed-order  estimator  satisfying  (5.1).  Thus  our  sufficient 
conditions  will  also  be  necessary  so  long  as  the  Auxiliary  Minimization  Problem  possesses  at  least 
one  extremal  over  S .  When  this  is  the  case  we  have  the  following  result. 

Proposition  5.1.  Let  7*  denote  the  infimum  of  ||.ff(s)||0o  over  all  asymptotically  stable  fixed- 
order  estimators  and  suppose  that  the  Auxiliary  Minimization  Problem  has  an  extremal  for  all 
7  >  7*.  Then  for  all  7  >  7*  there  exist  Q,P,Q,P  6  IN”  satisfying  (4.14)-(4.17). 


Appendix  A:  Proof  of  Theorem  4.1 

To  optimize  (3.21)  over  the  open  set  S  subject  to  the  constraint  (3.15),  form  the  Lagrangian 
£(At,Be,C',Q,P, A)  =  tr  {\QR  +  [AQ  +  QA?  + QRQ> +  V]P),  (A.l) 


where  the  Lagrange  multipliers  A  >  0  and  P  €  IR"*"  are  not  both  zero.  We  thus  obtain 

d£. 


dQ 


=  ( A  +  1-2QR)TP  +  P(A  +  1-3QR)  +  \R . 


Setting  =  0  yields 


0  =  (A  +  7~J  QR)TP  +  P{A  +  7'2  QR)  +  XR. 


(A.2) 


(A.3) 


Since  A  +  7  *QR  is  assumed  to  be  stable,  A  =  0  implies  P  =  0.  Hence,  it  can  be  assumed  without 
loss  of  generality  that  A  =  1.  Furthermore,  P  is  nonnegative  definite. 

Now  partition  n  x  n  Q,  P  into  n  x  n,n  x  n,,  and  n,  x  ne  subblocks  as 


'  Qx 

Q12] 

P  — 

'  Pi 

Pi  2 

Ql 2 

<?2  j  ’ 

r  — 

.PlT2 

P1  . 

and  for  notational  convenience  define 


PQ  = 


Z 1  ^12 

Zn  Zj 


where 


Z\  —  P1Q1  +  PuQJi,  Z\2  —  P\Q\2  +  PuQi, 

_  ^2t  —  P12Q1  +  P2Q12,  Z2  =  P12Q12  +  PiQ 2 • 
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Thus,  with  A  =  1  the  stationarity  conditions  are  given  by 


=  (A  +  'i-’QRfP  +  P{A  +  7"J  QR)  +  R  =  0, 
d  y 


(A.4) 


ar 

5A, 


=  Z,  =  0, 


(A.5) 


dC 
dB , 


=  Z,iCT+  pT^n  +  P2BeV2  =  0, 


(A.6) 


=  2BCe<?a  +  2^RCtZ^Qn  -  2 RLQU  -  7 ~2RLZ?Q12 

o  Oe 

-  I'tRLQiZu  -  'i~2RLZjlQ2  =  0. 


(A.7) 


Expanding  (3.15)  and  (A.4)  yields 

0  =  AQi  +  QxAT  +  Vx  +  7~a(«iiT  ~  <?»C7)P(QxLt  -  Qi3Cj)T,  (A.8) 

0  =  AQu  +  QhAJ  +  QiC^bJ +  V12BJ  +  7  *QiLtRLQ\2  —  7  2QuCJRLQi2 

-  ^~2QxLtRC,Q3  +  7 ~3QuC?RCeQ2,  (A.9) 

0  =  A.<?2  +  g2Aj  +  B'CQn  +  qJ3ctbJ  +  b,v3bJ 

+  l~2(Ql2Lr  -  Q2Cj)R{Qj3Lr  -  Q2Cj)T,  (A.10) 

0  =  AtPx  +  Pi  A  +  CTBeTpT,  +  PuBtC  +  1~7LTRLZ?  +  "f-*ZxLTRL 

-  7 -*LTRCtZ?3  -  i-*z12cJrl  +  LtRL,  (A.ll) 

0  =  AtPX2  +  P„A.  +  CTB.TP2  +  7 ~2LTRLZ^  -  i-2Z2lTRCe 

+  7 -*Zl3CjRCt  -  LTRCe,  (A.  12) 

0  =  AjP2  +  P3At  -  i~2CJRLZJ1  -  ‘1~2Z31LtRC€  +  CjRC,.  (A.13) 


Now  define  the  n  x  n  matrices 

Q  =  Qi~  QuQ^QL,  P  =  Pi~  PnPf'P?*, 
Q  =  Qi2Q2lQL,  P  =  Pi*trlP&, 
t  =  -Qx2Q31P?xP?3, 
and  the  nt  x  n,nt  x  nt,  and  n«  x  n  matrices 

G  =  Q3lQj3,  m±q3p3,  r  =  ~P3XP\3- 
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The  existence  of  Q^1  and  P2  1  follows  from  the  fact  that  {Ae,  Be,Ce)  is  minimal.  See  [1,2]  for 
details.  Note  that  r  =  GTr.  Clearly,  Q,P,Q,  and  P  are  symmetric  and  nonnegative  definite. 

Next  note  that  with  the  above  definitions,  (A.5)  implies  (4.2)  and  that  (4.1)  holds.  Hence 
r  =  GTr  is  idempotent,  i.e.,  r2  =  r.  Sylvester’s  inequality  yields  (4.18).  Note  also  that  (4.6)  and 
(4.7)  hold. 

The  components  of  2  and  P  can  be  written  in  terms  of  Q,P,  Q,P,G,  and  f  as 


Qi  —  Q  +  Q> 

Pi  =  p+p, 

(A. 14) 

^0 

to 
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Pu  =  pgt, 

(A.15) 

Q2  =  rQrr, 

P2  =  gpgt. 

(A.16) 

Next  note  that  by  using  (A.14)-(A.16),  (A.7)  becomes 

CeS  =  L[In  +  7-j(Q  +  Q)P]Gt, 

where 

S  =  In,  +  7  ~2rQPGT. 

To  prove  that  S  is  invertible  use  (4.6)  and  (4.3)  and  note  that 

In.  +  7 -2TQPGt  =  In,  +  7 -2rQrTPGT 

—  in,  +  7~2(r<?rT)(GPGT). 

Since  rQTT  and  GPGT  are  nonnegative  definite,  their  product  has  nonnegative  eigenvalues.  Thus 
each  eigenvalue  of  In,  +  7 ~2TQPGt  is  real  and  is  greater  than  unity.  Hence  S  is  invertible.  Now 
note  that  by  using  (4.2)  and  (4.3)  it  can  be  shown  that 

GrS~1r  =  Sr. 

The  expressions  (4.11),  (4.12)  and  (4.13)  follow  from  (A.6),  (A.7),  (4.8)  and  the  definition  of  Q 
by  using  the  above  identities.  Next,  computing  either  P(A.9)  —  (A.10)  or  G( A.12)  +  (A.13)  yields 
(4.10).  Substituting  this  expression  for  Ae  into  (A.8)  —  (A.13)  it  follows  that  (A.10)  =  r( A.9) 
and  (A.13)  =  G(A.12).  Thus,  (A.10)  and  (A.13)  are  superfluous  and  can  be  omitted.  Next,  using 
(A.8)  +  GTr(A.9)G  -  (A.9)G  -  [(A.9)G]T  and  GTr(A.9)G  -  (A.9)G  -  [(A.9)G]t  yields  (4.14)  and 
(4.16).  Using  (A.ll)  +  /’TG(A.12)r-(A.12)r-[(A.12)/’]TandrTG(A.12)r-(A.12)r— [(A.12)r]T 
yields  (4.15)  and  (4.17). 
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Finally,  to  prove  the  converse  we  use  (4.10)-{4.18)  to  obtain  (3.15)  and  (A.4)  -  (A.7).  Let 
At,Bt,Ct,G,r,r,Q,P,Q,  P,2  be  as  in  the  statement  of  Theorem  4.1  and  define  Qi,Qn, Qi,P\, 
Pi2iPi  by  (A.14)-(A.16).  Using  (4.4),  (4.11)  and  (4.12)  it  is  easy  to  verify  (A.6)  and  (A.7).  Finally, 
substitute  the  definitions  of  Q,P,Q,P,G,T  and  r  into  (4.14)-(4.17)  along  with  (4.2),  (4.3),  (4.6) 
and  (4.7)  to  obtain  (3.15)  and  (A.4).  Finally,  note  that 


Q  = 


Q  Onxn. 

In 

,  0n.  xn  0n> 

T 

r 

Q[in  r1), 


which  shows  that  Q  >  0.  □ 
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Abstract 

An  LQG  control-design  problem  involving  a  constraint  on  Hoo  disturbance  attenuation  is 
considered.  The  H0 0  performance  constraint  is  embedded  within  the  optimization  process  by 
replacing  the  covariance  Lyapunov  equation  by  a  Riccati  equation  whose  solution  leads  to  an  upper 
bound  on  Lj  performance.  In  contrast  to  the  pair  of  separated  Riccati  equations  of  standard  LQG 
theory,  the  /Too-constrained  gains  are  given  by  a  coupled  system  of  three  modified  Riccati  equations. 
The  coupling  illustrates  the  breakdown  of  the  separation  principle  for  the  Roo-constrained  problem. 
Both  full-  and  reduced-order  design  problems  are  considered  with  an  Hoc  attenuation  constraint 
involving  both  state  and  control  variables.  An  algorithm  is  developed  for  the  full-order  design 
problem  and  illustrative  numerical  results  are  given. 


Supported  in  part  by  the  Air  Force  Office  of  Scientific  Research  under  contracts  F49620-86-C- 
0002  and  F49620-87-C-0108. 


1.  Introduction 

The  fundamental  differences  between  Wiener-Hopf-Kalman  (WHK)  control  design  (for  exam¬ 
ple,  LQG  theory  [lj)  and  /Too  control  theory  (2 — 4]  can  be  traced  to  the  modeling  and  treatment 
of  uncertain  exogenous  disturbances.  As  explained  by  Zames  in  the  classic  paper  [2],  LQG  design 
is  based  upon  a  stochastic  noise  disturbance  model  possessing  a  fixed  covariance  (power  spectral 
density),  while  Hoo  theory  is  predicated  on  a  deterministic  disturbance  model  consisting  of  bounded 
power  (square-integrable)  signals.  Since  LQG  design  utilizes  a  quadratic  cost  criterion,  it  follows 
from  Plancherel’s  theorem  that  WHK  theory  strives  to  minimize  the  Lj  norm  of  the  closed-loop  fre¬ 
quency  response,  while  Hoo  theory  seeks  to  minimize  the  worst-case  attenuation.  For  systems  with 
poorly  modeled  disturbances  which  may  possess  significant  power  within  arbitrarily  small  band- 
widths,  Hoo  is  clearly  appropriate,  while,  for  systems  with  well-known  disturbance  power  spectral 
densities,  WHK  design  may  be  less  conservative. 

In  addition  to  the  fact  that  Ha 0  design  embodies  many  classical  design  objectives  [5],  it  also 
presents  a  natural  tool  for  modeling  plant  uncertainty  in  terms  of  normed  Hoo  plant  neighborhoods. 
In  contrast,  the  Hj  topology  has  been  shown  in  [6]  to  be  too  weak  for  a  practical  robustness 
theory,  while  the  Hoo  norm  is  not  only  suitable  for  robust  stabilization  but  is  also  conveniently 
submultiplicative.  Within  the  WHK  state  space  theory,  however,  the  appropriate  robustness  model 
appears  not  to  be  a  nonparametric  normed  plant  neighborhood  as  in  Hoo  theory,  but  rather  a 
parametric  uncertainty  model.  The  principal  technique  for  capturing  the  effects  of  real  parameters 
within  state  space  models  is  Lyapunov  function  theory  (see,  e.g.,  [7-16]  and  the  references  therein). 
Such  structured  uncertainties  are  difficult  to  capture  nonconservatively  within  Hoc,  theory  except 
with  specialized  refinements  ([17] ). 

In  spite  of  the  fundamental  differences  between  WHK  design  and  Hoo  theory,  a  significant 
connection  was  discovered  in  [18].  Specifically,  Petersen  observed  that  a  modified  algebraic  Riccati 
equation  developed  for  parameter-robust  full-state-feedback  control  can  also  be  utilized  to  yield 
controllers  satisfying  Hoo  disturbance  attenuation  bounds.  This  relationship  was  further  explored 
in  [19]  where  it  was  shown  that  Petersen’s  modified  Riccati  equation  effectively  yields  the  Hoo- 
optimal  full-state-feedback  controller.  This  result  is  based  upon  the  fact  that  quadratic  stability 
(i.e.,  stability  with  a  quadratic  Lyapunov  function)  of  the  system 

x  =  {A  +  DFE)x,  #(F)  <  1, 
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is  ^uivalent  to  the  stability  of  A  and  the  small  gain  condition 

||£:(s/-A)-1Dij0O  <  1. 

The  results  of  [19]  thus  solve  the  Standard  Problem  considered  in  [3,4]  for  the  static  full-state- 
feedback  case. 

The  extension  of  these  results  to  the  Standard  Problem  for  dynamic  output-feedback  compen¬ 
sation,  however,  was  not  given  in  [18,19].  Within  the  realm  of  quadratic  robust  stabilization,  the 
dynamic  output-feedback  problem  was  addressed  in  [7].  The  results  of  [7]  involve  a  pair  of  decou¬ 
pled  modified  Riccati  equations  along  with  an  auxiliary  inequality.  Using  different  techniques,  a 
moii  complete  solution  was  obtained  in  [13,14]  involving  a  coupled,  system  of  three  modified  Riccati 
equations  for  full-order  dynamic  compensation  and  a  coupled  system  of  four  modified  Riccati  and 
Lyapunov  equations  in  the  fixed-order  (i.e.,  reduced-order)  case  as  in  [20].  The  results  of  [13,14] 
thus  raise  the  following  question:  What  is  the  relevance  of  this  system  of  coupled  design  equations 
to  the  problem  of  Hoo  disturbance  attenuation  via  fixed-order  compensation? 

To  begin  to  address  this  question  the  goal  of  the  present  paper  is  to  develop  a  design  methodology 
for  fixed-order  Lj  optimal  control  which  includes  as  a  design  constraint  a  bound  on  Hoo  disturbance 
attenuation.  There  are  three  principal  motivations  for  developing  such  a  theory.  First,  the  results 
of  [18,19]  present  full-state-feedback  controllers  whose  form  is  directly  analogous  to  the  standard 
LQR  solution.  However,  no  Li  interpretation  was  provided  in  [18,19]  to  explain  this  similarity. 
The  present  paper,  however,  provides  an  Li  interpretation  within  the  context  of  an  design 
constraint.  A  novel  feature  of  this  mathematical  formulation  is  the  dual  interpretation  of  the 
disturbances.  That  is,  within  the  context  of  Li  optimality  the  disturbances  are  interpreted  as  white 
noise  signals  while,  simultaneously,  for  the  purpose  of  Hoo  attenuation  the  very  same  disturbance 
signals  have  the  alternative  interpretation  of  deterministic  Li  functions.  This  dual  interpretation  is 
unique  to  the  present  paper  since  stochastic  modeling  does  not  play  a  role  in  [18,19],  We  also  note 
recent  results  obtained  in  [21]  which  essentially  show  that  the  Hi  plant  topology  can  be  induced 
by  imposing  Li  and  Loo  topologies  on  the  disturbance  and  output  spaces,  respectively.  For  further 
investigation  into  the  relationships  between  Li  and  Hoo  control,  see  [22], 

The  second  motivation  for  our  approach  is  the  simultaneous  treatment  of  both  Li  and  Hoo 
performance  criteria  which  quantitatively  demonstrates  design  tradeoffs.  Specifically,  in  order  to 
enforce  the  Hoo  constraint  we  derive  an  upper  bound  for  the  Li  criterion.  Minimization  of  this 
upper  bound  shows  that  the  enforcement  of  an  Hoo  disturbance  attenuation  constraint  leads  directly 
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to  an  increase  in  the  Lj  performance  criterion.  Although  it  would  be  preferable  to  minimize  the 
Lj  criterion  directly,  this  problem  will  be  considered  in  a  future  paper. 

The  third  motivation  for  our  approach  is  to  provide  a  characterization  of  fixed-order  dynamic 
output-feedback  controllers  yielding  specified  disturbance  attenuation.  Existing  optimal  design 
methods  tend  to  yield  relatively  high-order  controllers.  Intuitively,  solving  the  fixed-order  design 
equations  for  progressively  smaller  £Too  disturbance  attenuation  constraints  should,  in  the  limit, 
yield  an  jffoo  optimal  controller  over  the  class  of  fixed-order  stabilizing  controllers.  Although  our 
main  result  gives  sufficient  conditions,  we  also  state  hypotheses  under  which  these  conditions  are 
also  necessary  (Proposition  4.1).  It  should  also  be  noted  that  the  inherent  coupling  among  the 
modified  Riccati  equations  shows  that  the  classical  separation  principle  of  LQG  theory  is  not  valid 
for  the  Hoo-constrained  full-  and  reduced-order  design  problems. 

Of  course,  since  the  present  paper  addresses  the  problem  of  fixed-order  dynamic  compensation, 
previous  full-state  feedback  results  ([18,19])  are  not  obtainable  as  a  special  case.  However,  applying 
the  approach  of  the  present  paper  to  the  full-state  feedback  problem  yields  results  which  are  similar 
to  those  of  [18,19]. 

Besides  establishing  connections  with  robust  stabilizability  in  state  space  systems,  an  imme¬ 
diate  benefit  of  the  modified  Riccati  equation  characterization  of  Hoo-optimal  controllers  is  the 
opportunity  to  develop  novel  computational  algorithms  for  controller  synthesis.  To  this  end  a  con¬ 
tinuation  algorithm  has  been  developed  for  solving  the  coupled  system  of  three  modified  Riccati 
equations.  In  a  numerical  study  (see  Section  8)  we  have  demonstrated  convergence  of  the  algorithm 
and  reasonable  computational  efficiency.  Homotopy  methods  were  suggested  for  the  coupled  Ric¬ 
cati  equations  because  of  their  demonstrated  effectiveness  in  related  problems  which  also  involve 
coupled  modified  Riccati  equations  [23-25].  Since  Hoo  control  problems  are  solvable  by  estab¬ 
lished  numerical  methods  [4],  it  should  be  stressed  that  the  objective  of  these  numerical  studies  is 
not  to  make  direct  comparisons  with  existing  synthesis  algorithms,  but  only  to  demonstrate 
solvability  of  the  coupled  modified  Riccati  equations. 

The  contents  of  the  paper  are  as  follows.  After  presenting  notation  at  the  end  of  this  section, 
the  statement  of  the  ifoo-Constrained  LQG  Control  Problem  is  given  in  Section  2.  The  principal 
result  of  this  section  (Lemma  2.1)  shows  that  if  the  algebraic  Lyapunov  equation  for  the  closed-loop 
covariance  is  replaced  by  a  modified  Riccati  equation  possessing  a  nonnegative-definite  solution, 
then  the  closed-loop  system  is  asymptotically  stable,  the  Hgo  disturbance  attenuation  constraint  is 
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satisfied,  and  the  Lj  performance  is  bounded  above  by  an  “auxiliary”  cost  function.  The  problem 
of  determining  compensator  gains  which  minimize  this  upper  bound  subject  to  the  Riccati  equation 
constraint  is  considered  in  Section  3  as  the  Auxiliary  Minimization  Problem.  Necessary  conditions 
for  the  Auxiliary  Minimization  Problem  (Theorem  3.1)  are  given  in  the  form  of  a  coupled  system  of 
three  modified  Riccati  equations.  In  Section  4  the  necessary  conditions  of  Theorem  3.1  are  combined 
with  Lemma  2.1  to  yield  sufficient  conditions  for  closed-loop  stability,  Hoo  disturbance  attenuation, 
and  bounded  Li  performance.  In  Section  5  we  specialize  the  results  of  Section  3  to  the  case  in 
which  the  LQG  weights  are  equal  to  the  H ,»  weights.  This  serves  to  equalize  the  L2  and  design 
aspects  and,  through  a  series  of  transformations,  the  results  of  Section  3  are  recast  in  a  simpler 
form.  These  results  also  clarify  connections  with  [26].  To  achieve  further  design  flexibility,  the 
reduced-order  control-design  problem  is  considered  in  Section  6.  A  simplified  qualitative  analysis 
of  the  full-order  design  equations  is  given  in  Section  7  to  highlight  important  features  with  regard 
to  existence  and  multiplicity  of  solutions.  Finally,  a  numerical  algorithm  is  presented  in  Section  8 
along  with  illustrative  numerical  results.  A  series  of  designs  are  obtained  to  illustrate  tradeoffs 
between  the  Li  and  aspects  and  the  conservatism  of  the  Li  performance  bound.  Although  in 
the  present  paper  the  numerical  results  are  limited  to  the  case  of  full-order  dynamic  compensation, 
reduced-order  designs  have  been  obtained  in  [27]  using  Theorem  6.1. 


Notation.  Note:  All  matrices  have  real  entries 
IR,  IRr**,  IRr,  DE  real  numbers,  r  x  a  real  matrices,  lRrxl,  expected  value 

r  x  r  identity  matrix,  transpose,  r  x  s  zero  matrix,  0rXr 
trace,  spectral  radius 

r  X  r  symmetric,  nonnegative-definite,  positive-definite  matrices 
Zi  —  Z\  €  INr,  Zi  —  Z\  €  IPr,  Z\t  Zi  €E  Sr 


fry  (  )T  y  0rx«>  Or 

tr,  p{  ) 

Sr,INr,IPr 

Z\  £  Zi ,  Z\  <  Zi 


ny  m,  i,  ne,p,  q,<joo]  n 

*>  **i  !/,*«)* 


A,  B,  C 
Aey  Bc,  Cc 

A 

«(■) 

Di,  Di 


positive  integers;  n  +  ne  (ne  <  n) 
n,m,l,net  fi-dimensional  vectors 
z 

,*e. 

nxn,  nxm,  <xn  matrices 
nc  x  ne,  ne  x  l,  m  x  ne  matrices 

A  BCe 
BeC  Ae  . 

p-dimensional  standard  white  noise 
n  x  p,  lx  p  matrices;  DiDf  =  0 
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Vi,  v3 
5 

v 


Ei,  E3 
E 

Ri,  R3 
R 


Eloo,  E200 

^loO)  Rioo 


E,E 

P,  7 


DiDf ,  D3Df\  V,  €  IP4 

'  Di  ■ 

bcd3 

^1  0f>  x  n, 

0„.xn  BcV3BJ, 
qxn,  q  x  m  matrices;  E^E3  —  0 
[2?1  f£}C<.] 

EfEi,  E\E3\  r2  e  IPm 


=  ete 


B\  Onxn, 

0  n.xn  CJR3Cc\ 

q<x>  *  n,  qoo  x  m  matrices;  EL  E3oo  —  0 


[JSloo 

EiooCe] 

EL  Ei 

00 >  E3ooE3 00 

Eloo 

0»x»« 

.On.  xn 

Cj  RiooCe 

=  £££00 


BRjlBT,  CTVf'C 


nonnegative  constant,  positive  constant 


2.  Statement  of  the  Problem 

In  this  section  we  introduce  the  LQG  dynamic  output-feedback  control  problem  with  con¬ 
strained  Hoo  disturbance  attenuation  between  the  plant  and  sensor  disturbances  and  the  state  and 
control  variables.  Without  the  Lj  performance  criterion  the  problem  considered  here  essentially 
corresponds  to  the  Standard  Problem  of  [3,4].  For  simplicity  we  restrict  our  attention  to  con¬ 
trollers  of  order  ne  =  n  only,  i.e.,  controllers  whose  order  is  equal  to  the  dimension  of  the  plant. 
This  constraint  is  removed  in  Section  6  where  controllers  of  reduced  order  are  considered.  Hence, 
throughout  Sections  2-5  the  controller  dimension  ne  and  closed-loop  plant  dimension  h  =  n  -f-  ne 
should  be  interpreted  as  n  and  2n,  respectively.  Controllers  of  order  greater  than  n  are  generally 
of  less  interest  in  practice  and  thus  are  not  considered  in  this  paper. 

Hoo- Constrained  LQG  Control  Problem.  Given  the  nth-order  stabilizable  and  detectable 
plant 


i(t)  =  Ax(t)  +  Bu(t)  +  Diw(t), 

(2.1) 

y(t)  =  Cx{t )  +  D2w(t), 

(2.2) 

5 


determine  an  nth-order  dynamic  compensator 

*e(0  =  -^c*e(0  “h  -®ey(0>  (2.3) 

u(t)  =  Cexc(t),  (2.4) 

which  satisfies  the  following  design  criteria: 

(i)  the  closed-loop  system  (2.1)— (2.4)  is  asymptotically  stable,  i.e.,  A  is  asymptotically  stable; 

(ii)  the  qoo  x  p  closed-loop  transfer  function 

H(s)^B00(aIii-A)-1b  (2.5) 

from  w(t)  to  Eioox(t)  +  E2oou(t)  satisfies  the  constraint 

ma)\\oo  <  7,  (2.6) 

where  >  0  is  a  given  constant;  and 

(iii)  the  performance  functional 

J(Ae,Be,Ce )  =*  Urn  IE[*r(t)fJlz(0  +  uT(f)i?2u(f)]  (2.7) 

is  minimized. 

Note  that  the  closed-loop  system  (2.1)-(2.4)  can  be  written  as 

x[t)  =  Ax{t)  +  Dw(t)  (2.8) 

and  that  (2.7)  becomes 

J(Ae,Bc,Ce)  =  fim  IE[(£x(f))r(Ex(t))]  =  Km  IE  [*r(t)  £*(«)]  •  (2-9) 

Remark  2.1.  Since  (A,  B,C)  is  assumed  to  be  stabilizable  and  detectable  the  set  of  nth-order 
stabilizing  compensators  is  nonempty. 

Remark  2.2.  It  is  easy  to  show  that  the  performance  functional  (2.7)  is  equivalent  to  the 
more  familiar  expression  involving  an  averaged  integral,  i.e., 

J(Ae,  Be,Ce)  =  ^lim^  J  [ir(s)R1r(s)  +  ut(s)/22u(s)]  dsj. 
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Remark  2.3.  For  convenience  we  assume  DiDj  =  0,  which  effectively  implies  that  the  plant 
disturbance  and  sensor  noise  are  uncorrelated. 

Remark  2.4.  One  may  wish  to  consider  a  general  L2  optimization  problem  of  the  form 
min||r  —  UQV j|j,  where  Q  is  a  parameterization  of  stabilizing  controllers.  In  this  case,  without  a 
constraint  on  the  MacMillan  degree  of  Q,  it  may  be  possible  to  satisfy  (2.6)  with  smaller  values  of 
1- 

Note  that  the  problem  statement  involves  both  L2  and  Hoo  performance  weights.  In  particular, 
the  matrices  R%  and  R2  are  the  L2  weights  for  the  state  and  control  variables.  By  introducing  L2~ 
weighted  variables 

z(t)  =  ElX(t),  v(t)  =  E2u(t), 

the  cost  (2.7)  can  be  written  as 

J[Ae,  Be,Ce)  =  lim  IE  [zT(t)z(i)  +  uT(t)v(t)j. 

t-*oo 

For  convenience  we  thus  define  Rx  =  Ef  E\  and  R2  =  E?  E2  which  appear  in  subsequent  expres¬ 
sions.  Although  an  h2  cross-weighting  term  of  the  form  2x(t)Ti?uu(t)  can  also  be  included,  we 
shall  not  do  so  here  to  facilitate  the  presentation. 

For  the  Hgo  performance  constraint,  the  transfer  function  (2.5)  involves  weighting  matrices  Eioo 
and  E2oo  for  the  state  and  control  variables.  The  matrices  I?loo  =  £’jr00-E’i00  and  R2oo  =  Ej^  E2oo 
are  thus  the  H ^  counterparts  of  the  L2  weights  R\  and  R2.  Although  we  do  not  require  that  i?l00 
and  R2oo  be  equal  to  R1  and  R2,  we  shall  require  in  the  next  section  that  R2oq  =  i?2 ,  where  the 

nonnegative  scalar  P  is  a  design  variable.  Finally,  the  condition  E‘[00E2oo  =  0  precludes  an  H0 0 
cross-weighting  term  which  again  facilitates  the  presentation. 

Before  continuing  it  is  useful  to  note  that  if  A  is  asymptotically  stable  for  a  given  compensator 
( Ae,Be,Cc )  then  the  performance  (2.7)  is  given  by 

J(Ae,Be,Ce)  =  trQR,  (2.10) 

where  the  steady-state  closed-loop  state  covariance  defined  by 

g=limIE[i(t)ir(t)]  (2.11) 

satisfies  the  n  x  n  algebraic  Lyapunov  equation 

Q  =  AQ  +  QAT  +  V.  (2.12) 
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Remark  2.5.  Using  (2.10)  and  (2.12)  it  can  oe  shown  that  the  Z,2  cost  criterion  (2.7)  can  be 
written  in  terms  of  the  Li  norm  of  the  impulse  response  of  the  closed-loop  system.  Specifically, 
writing  Q  satisfying  (2.12)  as 

Q  =  f  eAtVe*Ttdt, 

Jo 

(2.10)  becomes 

J(AetBe,Ce)  =  f°°  \\Ee**D\\*Fdt, 

Jo 

where  ||  •  ||*>  denotes  the  Frobenius  matrix  norm. 

The  key  step  in  enforcing  the  disturbance  attenuation  constraint  (2.6)  is  to  replace  the  alge¬ 
braic  Lyapunov  equation  (2.12)  by  an  algebraic  Riccati  equation  which  overbounds  the  closed-loop 
steady-state  covariance.  Justification  for  this  technique  is  provided  by  the  following  result. 


Lemma  2.1.  Let  (Ae,Be,Ce)  be  given  and  assume  there  exists  Q  €  IRnXn  satisfying 

Q  eiN* 


0  =  AQ  +  QAt  +  i~aQRooQ  +  V. 


Then 


if  and  only  if 


In  this  case, 


Consequently, 


where 


(A,  [7  3  Q  Roo  Q  +  V J  ^ )  is  stabilizable 


A  is  asymptotically  stable. 


||ff(s)lloo  <  7 


Q  <  2. 


J{Ae,Be,Ce)  <  J(Ae,Be,Ce,Q), 


J(Ae,Be,Ce>Q)  =  tr  QR. 


(2.13) 


(2.14) 


(2.15) 


(2.16) 


(2.17) 


(2.18) 


(2.19) 


(2.20) 


Proof.  Using  the  assumed  existence  of  a  nonnegative-definite  solution  to  (2.14)  and  the  stabi- 
lizability  condition  (2.15),  it  follows  from  the  dual  of  Lemma  12.2  of  [28]  that  A  is  asymptotically 
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stable.  Conversely,  if  A  is  asymptotically  stable  then  (2.15)  holds.  The  proof  of  (2.17)  follows  from 
a  standard  manipulation  of  (2.14);  for  details  see  Lemma  1  of  [29].  To  prove  (2.18)  subtract  (2.12) 
from  (2.14)  to  obtain 

0  =  A(Q-Q)  +  {Q-Q)AT  +  1~iQRooQ,  (2.21) 

which,  since  A  is  asymptotically  stable,  is  equivalent  to 

Q.-Q=  I"  e^*h“a  QRooQ]eATt  dt  >  0.  (2.22) 

Jo 

Finally,  (2.19)  follows  immediately  from  (2.18).  □ 

Remark  2.6.  Note  that  (2.15)  is  actually  a  closed-loop  “disturbability”  condition  which  is 
not  concerned  with  control  as  such.  This  condition  guarantees  that  the  system  does  not  possess 
unstable  undisturbed  modes.  Of  course,  if  V  is  positive  definite  or  (A,  D)  is  controllable,  then 
(2.15)  is  satisfied. 

Lemma  2.1  shows  that  the  Hoo  disturbance  attenuation  constraint  is  automatically  enforced 
when  a  nonnegative-definite  solution  to  (2.14)  is  known  to  exist.  Furthermore,  the  solution  Q 
provides  an  upper  bound  for  the  actual  closed-loop  state  covariance  Q  along  with  a  bound  on  the 
L-i  performance  criterion.  Next,  we  present  a  partial  converse  of  Lemma  2.1  which  guarantees  the 
existence  of  a  nonnegative-definite  solution  to  (2.14)  when  (2.17)  is  satisfied. 

Lemma  2.2.  Let  (Ae,  Bc,  Cc)  be  given,  suppose  A  is  asymptotically  stable,  and  assume  the 
disturbance  attenuation  constraint  (2.17)  is  satisfied.  Then  there  exists  a  unique  nonnegative- 
definite  solution  <2  satisfying  (2.14).  Furthermore,  (A  +  'i~,QR0 „,  V^)  is  stabilizable  if  and  only 
if  A  +  7'*2Roo  is  asymptotically  stable. 

Proof.  The  result  is  an  immediate  consequence  of  [30],  using  Theorems  3  and  2,  pp.  150  and 
167,  along  with  the  dual  version  of  Lemma  12.2  of  [28].  □ 

Remark  2.7.  To  further,  clarify  the  relationships  between  the  L2  and  Hoo  aspects  of  the 
problem,  we  note  that  the  closed-loop  system  can  be  represented  by  two  possibly  different  transfer 
functions.  Specifically,  with  respect  to  the  Lj  cost  criterion,  the  closed-loop  transfer  function 
between  disturbances  and  controlled  variables  is  given  by  the  triple  ( A,D,E )  while  for  the  Hoo 
constraint  the  closed-loop  transfer  function  (2.5)  corresponds  to  the  triple  (A,D,Eoo)- 

Finally,  it  can  be  shown  that  the  closed-loop  Riccati  equation  (2.14)  also  enforces  a  constraint 
on  the  norm  of  the  Hankel  operator  corresponding  to  the  closed-loop  system  (A,  D,  Ego)  when  <2 
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is  positive  definite.  Thus,  let  P  €  INn  denote  the  solution  to 

0  =  AtP  +  PA  +  Rq o  (2.23) 

and  note  that  P  and  Q  (satisfying  (2.12))  are  the  observability  and  controllability  Gramians,  respec¬ 
tively,  of  the  system  (A,  D,  Ego)-  As  shown  in  [31],  the  norm  of  the  Hankel  operator  corresponding 
to  (A,  D,  Eoo)  is  given  by  a|»x(P<5). 

Proposition  2.1.  Suppose  there  exists  Q  £  IP"  satisfying  (2.14)  and  such  that  (2.15)  or, 
equivalently,  (2.16)  holds.  Then 

At „(PQ)  <  7-  (2.24) 

Proof.  Since  Q  is  assumed  to  be  invertible,  (2.14)  is  equivalent  to 

0  =  7*Arfi-1  +  7  *Q-lA  +  722-1V’£T1  +  Ra Q.  (2.25) 

Subtracting  (2.23)  from  (2.25)  shows  that  7 *Q~l  —  P  >  0,  or,  equivalently,  7 2I„  >  Q1PQ1 .  Thus, 
*7  —  {Q*PQt)  = 

^ mmx  (P*Qpt)> 

^m&x  [piQpi)  =  Amax(PQ), 

which  yields  (2.24).  □ 

3.  The  Auxiliary  Minimization  Problem  and  Necessary  Conditions  for  Optimality 

As  discussed  in  the  previous  section,  the  replacement  of  (2.12)  by  (2.14)  enforces  the  Hoo 
disturbance  attenuation  constraint  and  yields  an  upper  bound  for  the  Lj  performance  criterion. 
That  is,  given  a  compensator  (Ae,  Be,Ce)  for  which  there  exists  a  nonnegative-definite  solution 
to  (2.14),  the  actual  Z,2  performance  J(Ae,Be,Cc)  of  the  compensator  is  guaranteed  to  be  no 
worse  than  the  bound  given  by  J(Ae,Be,Ce,  Q).  Hence,  J(Ae,  Bc,Cc,  Q)  can  be  interpreted  as  an 
auxiliary  coat  which  leads  to  the  following  mathematical  programming  problem. 

Auxiliary  Minimization  Problem.  Determine  (Ae,flc,Ce,  Q )  which  minimizes 
J(Ae,  Be,Ce,  Q)  subject  to  (2.13)  and  (2.14). 

It  follows  from  Lemma  2.1  that  the  satisfaction  of  (2.13)  and  (2.14)  along  with  the  generic  condi¬ 
tion  (2.15)  leads  to  1)  closed-loop  stability;  2)  prespecified  H0 0  performance  attenuation;  and  3)  an 
upper  bound  for  the  Lj  performance  criterion.  Hence  it  remains  to  determine  (Ae,  Be,Ce)  which 
minimizes  J(Ae,  Be,Ce,  fi)  and  thus  provides  an  optimized  bound  for  the  actual  Lj  performance 
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J(Ae,  Be,Ce).  Rigorous  derivation  of  the  necessary  conditions  for  the  Auxiliary  Minimization  Prob¬ 
lem  requires  additional  technical  assumptions.  Specifically,  we  restrict  (Ae,  Be,Cc,  Q)  to  the  open 
set 


X  —  {{Ae>BtfCei  2)  :  Q  €  DPn,  A  +  7  3QBoo  is  asymptotically  stable, 
and  ( Ae,Be,Ce )  is  controllable  and  observable}. 


(3.1) 


Remark  3.1.  The  set  X  constitutes  sufficient  conditions  under  which  the  Lagrange  multiplier 
technique  is  applicable  to  the  Auxiliary  Minimization  Problem.  Specifically,  the  requirement  that 
Q  be  positive  definite  replaces  (2.13)  by  an  open  set  constraint,  the  stability  of  A  +  i~2QRoo  serves 
as  a  normality  condition,  and  ( Ae,Be,Ce )  minimal  is  a  nondegeneracy  condition.  Note  that  the 
stabilizability  condition  (2.15)  and  stability  condition  (2.16)  play  no  role  in  determining  solutions 
of  the  Auxiliary  Minimization  Problem. 

The  following  result  presents  the  necessary  conditions  for  optimality  in  the  Auxiliary  Minimiza¬ 
tion  Problem.  The  proof  of  this  result  is  given  in  Appendix  A  as  a  special  case  of  the  corresponding 
result  for  reduced-order  dynamic  compensation  considered  in  Section  6.  As  mentioned  previously, 
we  assume  that  R2oo  =  Furthermore,  for  arbitrary  Q,P  €  IN"  define 

5^(/n  +  ^VSQP)-1.  (3.2) 


Since  the  eigenvalues  of  QP  coincide  with  the  eigenvalues  of  the  nonnegative-definite  matrix 
P*QP*  ,  it  follows  that  QP  has  nonnegative  eigenvalues.  Thus,  the  eigenvalues  of  In  +  f32~i~2QP 
are  all  greater  than  one  so  that  the  above  inverse  exists. 

Theorem  3.1.  If  (Ae,  Be,Ce,  Q)  €  X  solves  the  Auxiliary  Minimization  Problem  then  there 
exist  Q,P,Q  €  INn  such  that 


Ae  =  A  -  Q2-  EPS  +  'T’QRioo, 

(3.3) 

Be  =  QCTVf\ 

(3.4) 

Ce  =  -Rj1BTPS, 

(3.5) 

“  A  A  * 

$  +  Q 

V  —  A  A  , 

Q  Q 

(3.6) 

and  such  that  Q,P,Q  satisfy 

0  =  AQ  +  QAT  +  Vl  +  1-2QR1<>0Q-QSQ,  (3.7) 
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o  =  {A  +  Tf-*[Q  +  Q]Rlo o) tP  +  P(a  +  7 ~2[Q  +  Q]*l0o)  +  i?i  -  STPZPS,  (3.8) 
0  =  (A  -  ZPS  +  7~JQ*ioo)<?  +  Q{A  -  EPS  +  i-*QRioo)T 

+  1~*${Rioo  +  P2StPZPS)Q  +  QSQ.  (3.9) 

Furthermore,  the  auxiliary  cost  is  given  by 

J{Ae,Be,Ce,Q)  =  tr[(Q  +  Q)R1  +  QSTPZPS].  (3.10) 

Conversely,  if  there  exist  Q,P,Q  €  IN”  satisfying  (3.7)-(3.9),  then  (Ae,  Be,Cc,  Q)  given  by  (3.3)- 
(3.6)  satisfies  (2.13)  and  (2.14)  with  auxiliary  cost  (2.20)  given  by  (3.10). 

Remark  3.2.  If  Q  and  Q  are  nonnegative  definite  then  the  fact  that  (2.13)  is  satisfied  can 
easily  be  seen  by  writing  Q  as 


Q  0n 

W] 

M*1 

On  0B. 

+ 

Q\ 

Remark  3.3.  Setting  $  =  0  or,  equivalently,  £joo  =  0,  specializes  Theorem  3.1  to  the  “cheap” 
ffoo  control  case  in  which  attenuation  between  disturbances  and  controls  is  not  constrained. 


In  this  case  S  =  In,Q  is  given  by  (3.6),  and 

Ae  =  A-QZ-ZP  +  ^QR^,  (3.11) 

Bc  =  QCTVf\  (3.12) 

Ce  =  -R;lBTP,  (3.13) 

where  Q  satisfies  (3.7),  and  equations  (3.8)  and  (3.9)  become 

0  =  (A  +  7',[Q  +  <9]*ico)TP  +  P{A  +  7"s[Q  +  Q}Rioo)  +  Ri-  PZP,  (3.14) 


0  =  (A  -  ZP  +  ^QRt^Q  +  Q(A  -ZP  +  7'*<?*ioo)r  +  l~2QRiooQ  +  Q^Q.  (3.15) 

Finally,  the  auxiliary  cost  reduces  to 

J(Ae,Be,Ce,Q)=  tr[(Q  +  Q)R1  +  <?/>27P].  (3.16) 

Numerical  solution  of  equations  (3.7),  (3.14)  and  (3.15)  is  discussed  in  Section  8. 

Theorem  3.1  presents  necessary  conditions  for  the  Auxiliary  Minimization  Problem  which  ex¬ 
plicitly  synthesize  extremal  controllers  (Ae,  Bc,Ce).  These  necessary  conditions  comprise  a  system 
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of  three  modified  algebraic  Riccati  equations  in  variables  Q,P  and  Q.  The  Q  and  P  equations 
are  similar  to  the  estimator  and  regulator  Riccati  equations  of  LQG  theory,  while  the  Q  equation 
has  no  counterpart  in  the  standard  theory.  Note  that  the  Q  equation  is  decoupled  from  the  P 

A 

and  Q  equations  and  thus  can  be  solved  independently.  The  P  equation,  however,  depends  on 
Q.  Thus,  regulator/estimator  separation  only  holds  in  one  direction  which  clearly  shows  that  the 
certainty  equivalence  principle  is  no  longer  valid  for  the  design  problem  under  consideration.  Fur¬ 
thermore,  since  the  P  and  Q  equations  are  coupled,  they  must  be  solved  simultaneously.  Finally, 
note  that  if  the  Poo  disturbance  attenuation  constraint  is  sufficiently  relaxed,  i.e.,  7  — »  00,  then 
the  P  equation  becomes  decoupled  from  the  Q  equation  and  thus  the  Q  equation  becomes  super¬ 
fluous.  Furthermore,  the  remaining  Q  and  P  equations  separate  and  coincide  with  the  standard 
LQG  result. 

4.  Sufficient  Conditions  for  P^  Disturbance  Attenuation 

In  this  section  we  combine  Lemma  2.1  with  the  converse  of  Theorem  3.1  to  obtain  our  main 
result  guaranteeing  closed-loop  stability,  Poo  disturbance  attenuation,  and  an  optimized  L2  per¬ 
formance  bound. 

Theorem  4.1.  Suppose  there  exist  Q,P,Q  €  IN"  satisfying  (3.7)-(3.9).  Then,  with 
(Ae,Be,Ce,Q)  given  by  (3.3)-(3.6),  (A,It*  QB^Q+V}*)  is  stabilizable  if  and  only  if  A  is  asymp¬ 
totically  stable.  In  this  case,  the  closed-loop  transfer  function  P(s)  satisfies  the  P*,  attenuation 
constraint 

IlffMII-  <  7,  (4.1) 

and  the  L3  performance  criterion  (2.7)  satisfies  the  bound 

J(Ae,  Be,Ce)  <  tr[(Q  +  Q)Ri  +  QSTPSPS].  (4.2) 

Proof.  The  converse  portion  of  Theorem  3.1  implies  that  Q  given  by  (3.6)  satisfies  (2.13)  and 
(2.14)  with  auxiliary  cost  given  by  (3.10).  It  now  follows  from  Lemma  2.1  that  the  stabilizability 
condition  (2.15)  is  equivalent  to  the  asymptotic  stability  of  A,  the  F#,  disturbance  attenuation 
constraint  (2.17)  holds,  and  the  performance  bound  (2.19),  which  is  equivalent  to  (4.2),  holds.  □ 

Remark  4.1.  In  applying  Theorem  4.1  it  is  not  actually  necessary  to  check  (2.15)  which 
holds  generically.  Rather,  it  suffices  to  check  the  stability  of  A  directly  which  is  guaranteed  to  be 
equivalent  to  (2.15). 
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In  applying  Theorem  4.1  the  principal  issue  concerns  conditions  on  the  problem  data  under 
which  the  coupled  Riccati  equations  (3.7)-(3.9)  possess  nonnegative-definite  solutions.  Clearly, 
for  7  sufficiently  large,  (3.7)-(3.9)  approximate  the  standard  LQG  result  so  that  existence  and 
uniqueness  are  assured.  The  important  case  of  interest,  however,  involves  small  7  so  that  significant 
Hog  disturbance  attenuation  is  enforced.  Thus,  if  (4.1)  can  be  satisfied  for  a  given  7  >  0,  it  is  of 
interest  to  know  whether  one  such  controller  can  be  obtained  by  solving  (3.7)-(3.9).  Lemma  2.2 
guarantees  that  (2.14)  possesses  a  solution  for  any  controller  satisfying  (4.1).  Thus  our  sufficient 
condition  will  also  be  necessary  so  long  as  the  Auxiliary  Minimization  Problem  possesses  at  least 
one  extremal  over  X .  When  this  is  the  case  we  have  the  following  immediate  result. 

Proposition  4.1.  Let  7*  denote  the  infimum  of  ||.H'(s)}|00  over  all  stabilizing  nth-order  dynamic 
compensators  and  suppose  that  the  Auxiliary  Minimization  Problem  has  a  solution  for  all  7  >  7*. 
Then  for  all  7  >  7*  there  exist  Q,P,Q  €  INn  satisfying  (3.7)-(3.9). 

Unlike  the  standard  LQG  result  involving  a  pair  of  separated  Riccati  equations,  the  new  result 
enforcing  disturbance  attenuation  involves  a  nonstandard  coupled  system  of  three  modifed 
Riccati  equations.  The  asymmetry  of  these  equations  suggests  the  possibility  of  a  dual  result  in 
which  the  modifications  to  the  standard  P  and  Q  Riccati  equations  are  reversed.  Such  a  dual  result 
wifi  generally  be  different  from  Theorem  4.1  and  thus  will  yield  an  improved  bound  for  particular 
problems.  This  point  was  demonstrated  in  [16]  for  the  problem  of  robust  performance  analysis. 
Due  to  space  limitations,  however,  we  give  only  a  brief  outline  of  the  dual  H results.  Note  that 
J(Ae,Be,Cc)  given  by  (2.10)  is  also  given  by 

J(Ae,BeiCe)=  tr  PV ,  (4.3) 

where  P  €  INn  is  the  unique  solution  to  (2.23).  Next,  utilizing  (4.3)  in  place  of  (2.10),  the  Hoo 
disturbance  attenuation  constraint  (2.6)  can  now  be  enforced  by  replacing  (2.23)  by  the  Riccati 
equation 

0  =  AtP  +  PA  +  i-2PVP  +  Roo.  (4.4) 

Note  that  (4.4)  is  merely  the  dual  of  (2.14).  We  also  require  the  condition  dual  to  (2.15)  given  by 

([l^PVP  +  R oo]^,A)  is  detectable.  (4.5) 

Once  again,  the  sufficient  conditions  for  H disturbance  attenuation  involve  a  coupled  system  of 
three  modified  Riccati  equations  dual  to  (3.7)-(3.9).  Similar  remarks  apply  to  the  reduced-order 
case  given  by  Theorem  6.1  below. 
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5.  Alternative  Forms  of  the  Riccati  Equations 

The  purpose  of  this  section  is  to  draw  connections  with  recent  results  obtained  in  [26] .  As 
shown  in  Theorem  4.1,  the  Riccati  equations  (3.7)-(3.9)  provide  sufficient  conditions  for  explicitly 
synthesizing  controllers  (Ae,  Bc,Ce)  satisfying  an  P*,  performance  bound.  In  this  section  we 
specialize  Theorem  3.1  by  setting  the  LQG  weights  equal  to  the  weights,  i.e.,  =  Rloo 

and  0  =  1.  This  specialization  leads  to  considerable  simplification  by  equalizing  the  L2  and 
design  aspects.  In  this  case  it  turns  out  that  the  Riccati  equations  (3.7)-(3.9)  can  be  transformed 
to  simpler  forms  which  are  similar  to  the  results  given  in  [26].  To  state  the  results  we  require 
some  additional  notation  and  a  lemma  concerning  transformations  of  a  pair  of  nonnegative-definite 
matrices. 

Lemma  5.1.  Let  P,Q  6  IN".  Then  the  following  statements  hold. 

(i)  PQ  has  nonnegative  eigenvalues. 

(ii)  p(PQ)  <  {<)l~2  if  and  only  if  P^QPi  <  Furthermore,  if  P  is  positive  definite 

then  p{PQ)  <  (<)7-2  if  and  only  if  Q  <  (<)7-JP-1. 

(iii)  Define  Z  =  P(/„  +  7-3P<2)-1.  Then  Z  is  nonnegative  definite, 

Piln  +  l-’QP)-1  =  ( In  +  l~2PQ)-lP ,  (5.1) 

and  p{ZQ)  <  ~j~3  or,  equivalently,  Q*ZQ»  <  7 ~2In .  Furthermore,  Z  is  positive  definite 
if  and  only  if  P  is  positive  definite.  In  this  case, 

Z  =  (P-i+7-*q)~i.  (5.2) 

(iv)  Suppose  p{PQ)  <  7_J  and  define  Y  =  P(/n  -  l~2QP)~l ■  Then  Y  is  nonnegative  definite, 

P{ln  -  7 -2QP)~l  =  {In  -  7 -2PQ)-'P,  (5.3) 

and 

QP{In  -  l~2QP)~l  =  {In  -  7 -2QP)~lQP.  (5.4) 

Furthermore,  P  is  positive  definite  if  and  only  if  Y  is  positive  definite.  In  this  case, 

Y  =  {P-'~1-*Q)-\  _  (5.5) 
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Proof.  The  results  are  easily  proven  and  thus  the  details  are  omitted.  □ 

Proposition  5.1.  Let  =  Rico,  0  =  1,  suppose  there  exist  Q,Q  G  INn  and  Z  €  Pn 


satisfying 


0=  AQ  +  QAt +  Vi  +  1~2QRiQ  -QZQ,  (5.6) 

0  =  (A  +  7-'QRi)tZ  +  Z(A  +  i-'QRi)  +  Ri  -  ZXZ  +  7~2 ZQZQZ ,  (5.7) 

0  =  (A  -  ZZ  +  i~2QRi)Q  +  Q(A  -  SZ  +  i~2QRi)T  +  7 ~2Q{Ri  +  ZZZ)Q  +  QEQ,  (5.8) 


p{ZQ )  <  7  2, 


and  let  (Ae,Be,Cc,  2)  be  given  by 


Ae  =  A  -  QS  -  SZ  +  7 ~2QRu 
Be  =  QCTVf\ 

Ct  =  -R^1BtZ, 

qJq  +  *  ?}. 

Q  Q 


(5.10) 

(5.11) 

(5.12) 

(5.13) 


Then  (A,[i~2QRQ  +  V}t)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  case, 
the  closed-loop  transfer  function  H (s)  satisfies  the  Hoc  disturbance  attenuation  constraint 


\\m\\oo  <  7, 

and  the  Lj  performance  criterion  (2.7)  satisfies  the  bound 

J(Ac,Be,Ce)<  tr [{Q  +  Q)Ri+QZZ;z}. 


(5.14) 


(5.15) 


Proof.  We  need  only  show  that  (5.6)-(5.9)  imply  (3.7)-(3.9).  Clearly,  (3.7)  is  a  restatement 
of  (5.6).  Since  Z  is  positive  definite  and  p(ZQ)  <  ~t~2,  it  is  possible  by  Lemma  5.1  (iv)  to  define 
P  =  Z(In  —  7 ~2QZ)~1  =  ( Z~l  -  7-jQ)-1.  Furthermore,  P  is  positive  definite  and  it  follows 
that  Z  =  PS.  Thus  (5.8)  implies  (3.9).  To  obtain  (3.8),  form  P[Z~1(S.7)Z~1  —  7_J(5.8)]P  and 
combine  terms.  □ 

Remark  5.1.  It  is  easy  to  see  that  the  proof  of  Proposition  5.1  can  be  reversed.  That  is, 
when  P  satisfying  (3.8)  is  positive  definite  define  Z  =  (P-1  +7-3<?)-1  which  leads  to  (5.7)  and 
(5.8)  using  Lemma  5.1  (iii).  Thus,  when  P  is  positive  definite,  the  form  of  the  equations  (5.6)-(5.9) 
represents  no  loss  of  generality. 
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Proposition  5.2.  Let  Ri  =  Rioo,P  =  li  suppose  there  exist  Q,Q  6  IN"  and  P0  G  EPn 


satisfying 


0  =  AQ  +  QAT +Vl+'1~iQR1Q  -QSQ,  (5.16) 

0  =  ArP0  +  PoA  +RX+  7~2PoViPo  -  PQZP0,  (5.17) 

0  =  [A  -  SP0(In  ~  l-'QPo)-1  +  7~2QRi]Q  +  Q[A-  ZP0(In  -  7~2QPq)~1  +  7~2QRi)T 
+  7~8<3[i?i  +  Po(In  ~  7~2QPo)~lZ{In  -  7-2PoQ)-lPo]Q  +  QZQ,  (5.18) 


p[(Q  +  Q)Po}<7~2, 


and  let  ( Ac,Be,Cc ,  Q)  be  given  by 


Ae  =  A-QS-  SPo(In  ~  7~2QPq)~1  +  7~2QRu 
Bc=QCtV2~\ 

Ce  =  - R21BTP0(In  -  7~2QPo)-\ 

Q  Q 


(5.18) 

(5.19) 

(5.20) 

(5.21) 

(5.22) 

(5.23) 


Then  (A,  [~t~2QRQ.  +  V^)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  case, 
the  closed-loop  transfer  function  H(s )  satisfies  the  H «*,  disturbance  attenuation  constraint 


\\H(s)\\oo  <  7, 

and  the  L2  performance  criterion  (2.7)  satisfies  the  bound 


(5.24) 


J(Ac,Be,Ce)  <  tr[(Q  +  Q)R\  +  QPo{In  -  7~2QPo)~1Z(In  —  7~2PoQ)~1Pq]-  (5.25) 

Proof.  As  in  the  proof  of  Proposition  5.1,  it  need  only  be  shown  that  (5.16)-(5.19)  imply 
(3.7)-(3.9).  Hence  define  P  =  [P0-1  -  7 ~2(Q  +  <?)]_1  and  form  the  equation  P[P<f  1(5.17)Pj'1  - 
7~J(5.16)  —  7_2(5.18)]P  to  obtain  (3.8).  Equations  (3.7)  and  (3.9)  are  immediate.  □ 

Remark  5.2.  To  clarify  the  relationships  among  (3.7)-(3.9),  (5.6)-(5.8),  and  (5.16)-(5.18), 
we  tabulate  the  transformations  involving  P,  Z  and  P0 : 

P  =  (Z-1  -  7~2QYX  =  [i’o-1  -  7 -2(Q  +  Q)]"1, 

Z  =  (P-1  +  7 -’Q)-1  =  ( Po  1  -  7 -2Q)-\ 

Po  =  (Z-1  +  7~2Q)-1  =  [P-1  +  7_S(<3  +  Q)]'1. 
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(5.26) 

(5.27) 

(5.28) 


•  Remark  5.3.  It  is  important  to  note  that  numerically  solving  equations  (5.6)-(5.8)  and  (5.16)- 
(5.18)  does  not  require  that  Z  and  Pq  be  invertible.  As  shown  in  the  Proofs  of  Propositions  5.1 
and  5.2  the  positive  definiteness  assumptions  are  used  to  construct  equation  (3.8). 

Remark  5.4.  Note  that  the  gains  (5.10)-(5.12)  and  (5.16)-(5.18)  of  Propositions  5.1  and  5.2 
are  independent  of  the  matrix  Q  satisfying  equations  (5.8)  and  (5.18).  Nevertheless,  equations 
(5.8)  and  (5.18)  must  have  a  solution  in  order  to  enforce  the  solvability  of  (2.14)  which  implies 
that  the  constraint  is  satisfied.  Thus  our  result  does  not  yield  a  guarantee  of  performance 
unless  (5.8)  and  (5.18)  can  be  solved  numerically.  Of  course,  Q  is  also  required  to  evaluate  the  Li 
performance  bound  (5.15)  or  (5.25).  Note  that  the  solutions  of  Q  and  Po  of  (5.16)  and  (5.17)  are 
analogous  to  the  matrices  Xoo  and  of  [26].  Finally,  note  that  (5.19)  implies  that  p(QPo)  <  7-2 
which  is  essentially  condition  5.2  (iii)  of  [26]. 

Remark  5.5.  The  transformations  (5.26)-(5.28)  used  to  obtain  the  form  of  the  equations  given 
by  Propositions  5.1  and  5.2  depend  strongly  upon  the  assumptions  Rioo  =  Ri  and  =  1.  That 
is,  if  either  fZloo  ^  Ri  or  0  ^  1  then  these  transformations  cannot  be  carried  out.  Thus,  although 
(5.6)-(5.8)  <ind  (5.16)-(5.18)  possess  numerical  advantages  over  (3.7)-(3.9),  these  alternative  forms 
exist  only  in  the  very  special  case  in  which  the  L *  and  if*,  weights  are  equalized.  Moreover,  in 
the  presence  of  parameter  uncertainties  ([13,15])  or  nonstrictly  proper  controller  design  ([32]),  such 
transformations  seem  to  be  precluded. 

Remark  5.6.  It  is  interesting  to  note  that  equations  (5.6)  and  (5.7)  with  controller  gains 
(5.10)-(5.12)  are  already  known  since  they  are  identical  to  the  optimality  conditions  of  the 
exponential-quadratic-Gaussian  problem  treated  in  [33].  Specifically,  see  equations  (3.1)  and  (4.1) 
on  pages  603  and  609,  respectively.  As  shown  in  [33],  minimizing  the  criterion 

J=  lim  Eiie*(ir*lI+uT*aU> 

t—*oo 

leads  to  the  pair  of  modified  Riccati  equations  (5.6)  and  (5.7)  with  replaced  by  p.  This  implies 
that  with  equation  (5.8)  the  exponential-of-quadratic  design  problem  effectively  enforces  a  bound 
of  on  the  norm  of  the  closed-loop  transfer  function.  What  remains  to  be  achieved  then  is 
a  deeper  understanding  of  this  connection.  For  related  references,  see  [34,35]. 
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6.  Extensions  to  Reduced-Order  Dynamic  Compensation 

In  this  section  we  extend  Theorem  4.1  by  expanding  the  formulation  of  Section  3  to  allow  the 
compensator  to  be  of  fixed  dimension  ne  which  may  be  less  than  the  plant  order  n.  Hence,  in  this 
section  define  n  =  n  +  ne>  where  nc  <  n.  As  in  [20]  this  constraint  leads  to  an  oblique  projection 
which  introduces  additional  coupling  in  the  design  equations  along  with  an  additional  equation. 
The  following  lemma  is  required. 

Lemma  6.1.  Let  Q,P  €  INn  and  suppose  rank  QP  =  ne.  Then  there  exist  nc  x  n  G,T  and 
ne  x  ne  invertible  M,  unique  except  for  a  change  of  basis  in  IRn° ,  such  that 

QP  =  GTMr,  rGT  =  In ,.  (6.1),  (6.2) 

Furthermore,  the  n  x  n  matrices 

r±GTr,  r±  =  In  -  t  (6.3),  (6.4) 

are  idempotent  and  have  rank  ne  and  n  —  ne,  respectively. 

Proof.  Conditions  (6.l)-(6.4)  are  a  direct  consequence  of  Theorem  6.2.5  of  [36],  □ 
Theorem  6.1.  Let  nc  <  n,  suppose  there  exist  Q,P,Q,P  €  IN"  satisfying 
0  =  AQ  +  QAt  +  Vi  +  l~2QRiooQ  ~  Q2Q  +  t±Q2QtZ, 

0  =  (A  +  7“J[Q  +  g]*ioo)TP  +  P{A  +  7  ~J[Q  +  Q]Ri  oo)  +  Ri 
-  STPSPS  +  fZsTPZPSr±, 

0  =  (A  -  UPS  +  7“2Q*ioo)<3  +  Q{A  -  UPS  +  7_2Qf?ioo)T 
+  7'2Q(f2ioo  +  pSTPZPS)Q  +  QZQ  -  r^QZQrl, 

0  =  (A-Q£  +  T'QRioofP  +  P(A  -  Q£  +  7~2Q*ioo) 

+  STPSPS  -  rl STPZPSr±, 

rank  Q  =  rank  P  =  rank  QP  =  nc, 
and  let  (Ac,Be,Cc,  Q)  be  given  by 

Ae  =  r(A  -  gr  -  rps  +  i~,qr1oo)gt, 

Be  =  rQCTVfl, 

ce  =  -r^btpsgt, 

Q=  [g+g  grr ' 
rg  rgpT 


(6.5) 

(6.6) 

(6.7) 

(6.8) 
(6.9) 

(6.10) 

(6.11) 

(6.12) 

(6.13) 
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Then,  {A,[T*QR «,fl-|-V]*)  is  stabilizable  if  and  only  if  A  is  asymptotically  stable.  In  this  case, 
the  closed-loop  transfer  function  H (s)  satisfies  the  Hoo  disturbance  attenuation  constraint 


IlffWIloo  <  7, 


and  the  Li  performance  criterion  (2.7)  satisfies  the  bound 


J{Ae,Be>Ce)  <  tr[(g  +  Q)Ri  +  QSTPZPS]. 


(6.14) 


(6.15) 


Remark  6.1.  It  is  easy  to  see  that  Theorem  6.1  is  a  direct  generalization  of  Theorem  4.1. 
To  recover  Theorem  4.1,  set  nc  =  n  so  that  r  =  G  =  T  =  In  and  rj.  =  0.  In  this  case  the  last 
term  in  each  of  (6.5)-(6.8)  can  be  deleted  and  equation  (6.8)  becomes  superfluous.  Furthermore, 
(6.5)-(6.7)  nosv  reduce  to  (3.7)— (3.9),  as  expected.  If,  furthermore,  0  =  0  then  S  —  In  so  that 
equations  (6.5)-(6.7)  now  reduce  to  the  “cheap”  Hoo  control  case  given  by  (3.7),  (3.14)  and  (3.15). 
Alternatively,  setting  7  =  oo  and  retaining  the  reduced-order  constraint  nc  <  n  yields  the  result  of 
[20]. 


Remark  6.2.  Consider  the  case  Rioo  =  R i  and  0=1.  By  introducing  a  new  variable 
Z  =  PS  =  (P~l  +  'y~2Q)~1  as  in  Section  5,  equation  (6.6)  becomes 

0  =  (A  +  7“2QRi)TZ  +  Z(A  +  i-’QRi)  +  Ri 

(6.16) 

-  ZZZ  +  tIZEZt±  +  7 -*Z{Q£Q  -  txQ2QtI]Z. 

Note  that  (6.16)  specializes  to  (5.7)  when  rx  =  0  (i.e.,  ne  =  n).  Furthermore,  PS  can  be  replaced 
by  Z  in  (6.7)-(6.12).  Next,  to  generalize  (5.17),  define  P0  as  in  (5.28)  so  that  (5.17)  becomes 

0  =  ATPo  +  P0A  +  R1  +  'j-'iPoVlP0-Po2Po 

+  (/»  -  7"a/>og)rI(/n  -  j-'PoQr'PaZPoiln  ~  l^QPo)-1^  -  l~2QPo).  ^ 

Again,  (6.17)  specializes  to  (5.17)  when  rx  =  0. 


7.  Analysis  of  the  Design  Equations 

Before  developing  numerical  algorithms,  it  is  instructive  to  analyze  the  design  equations  to 
determine  existence  and  multiplicity  of  nonnegative-definite  solutions.  Although  a  detailed  theo¬ 
retical  analysis  remains  an  area  for  future  research,  in  this  section  we  present  a  simplified  treatment 
which  highlights  important  asymptotic  properties  of  the  equations.  It  turns  out  that  several  key 
properties  are  discernible  by  considering  the  scalar  case  n  =  1.  Although  many  of  these  properties 


can  be  developed  for  general  n,  the  simplified  scalar  case  suffices  for  obtaining  a  useful  qualitative 
analysis.  Here  we  consider  only  (3.7),  (3.14)  and  (3.15). 

Since  the  Q  equation  (3.7)  is  decoupled  from  (3.14)  and  (3.15),  it  can  be  analyzed  separately. 
It  is  easy  to  see  that  there  exists  a  unique  nonnegative  solution  for  7  >  (Ri/2)$  as  in  the  case  of 
a  standard  Riccati  equation  with  stabilizability  and  detectability  hypothesis.  Furthermore,  it  can 
be  seen  that  for 

(*/[£  + (Aa/Vi)])*  <7<  (*1  /£)* 

there  exist  two  nonnegative  solutions  when  A  is  stable  and  zero  nonnegative  solutions  when  A  is 
unstable.  Below  this  lower  bound  for  7  nonnegative  solutions  Q  do  not  exist.  This  result  thus 
indicates  (as  in  LQG  theory  [42])  a  lower  bound  to  the  achievable  H <*,  disturbance  attenuation  as 
determined  by  the  sensor  noise  intensity  V2  appearing  in  2. 

Since  the  P  and  Q  equations  (3.14)  and  (3.15)  are  coupled  they  must  be  analyzed  jointly. 
Since  (3.15)  is  a  standard  Riccati  equation,  it  follows  under  generic  hypotheses  that  it  possesses 
exactly  one  nonnegative-definite  solution  for  all  values  of  Q  and  Q-  The  analysis  of  the  Q  equation 
is,  however,  more  involved.  It  can  be  shown  that  the  existence  of  real  solutions  is  a  complicated 
function  of  7 ,Q,  and  P.  When  real  solutions  do  exist,  it  follows  that  there  exist  either  zero  or  two 
nonnegative-definite  solutions.  To  obtain  further  qualitative  insight  into  the  solutions  P  and  Q  we 
fix  7  and  allow  R2  — *  0,  that  is,  the  cheap  L2  control  case.  It  thus  follows  that  P  ~  (Rx/2)$ 
and  that  either  Q  ~  2j2(2/Ri)$  or  Q  ~  ^2Q2(2  Ri)~$ ,  which  correspond  to  the  previously 
mentioned  pair  of  solutions  satisfying  (3.15).  This  result  thus  indicates  that  an  arbitrarily  small 
Poo  disturbance  attenuation  constraint  7  can  be  achieved  (subject  to  the  solvability  of  (3.7))  by 
sufficiently  increasing  the  L2  controller  authority.  That  is,  since  solutions  exist  in  the  cheap  L2 
control  case,  the  Poo  disturbance  attenuation  constraint  is  achievable.  The  ability  to  achieve  small 
7  is  also  attributable  to  the  fact  that  since  0  =  0,  H 00  disturbance  attenuation  to  the  control 
variables  is  not  limited  in  (3.7),  (3.14)  and  (3.15)  as  in  Theorems  3.1  and  6.1.  Of  course,  as  is 
well  known,  it  is  not  possible  to  make  7  — ♦  0  by  letting  2  — ►  00  and  2  — *  00  when  the  system 
possesses  nonminimum  phase  zeros.  Also,  note  that  both  of  the  asymptotic  solutions  to  (3.15)  are 
guaranteed  to  yield  the  bound  (4.1).  The  solution  of  interest,  however,  is  Q  =  0(2~$ )  since  it 
clearly  yields  a  lower  value  of  J(Ae,Bc,Ce,  Q)  than  Q  =  0(2$).  Finally,  similar  analysis  can  be 
applied  to  (5.6)-(5.8)  and  (5.16)-(5.18). 
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8.  Numerical  Algorithm  and  Illustrative  Results 

In  this  section  we  describe  a  numerical  algorithm  which  has  been  developed  and  implemented 
for  solving  the  coupled  Riccati  equations  (3.7),  (3.14)  and  (3.15).  We  also  present  numerical  results 
for  an  illustrative  example. 

Coupled  modified  Riccati  equations  arise  in  a  variety  of  problems  and  homotopic  continuation 
methods  have  been  shown  to  be  particularly  successful  [23-25].  To  solve  (3.7),  (3.14)  and  (3.15)  we 
have  implemented  a  simplified  continuation  method  involving  the  constraint  constant  7.  The  idea 
is  to  exploit  the  fact  that  for  large  7  the  problem  is  approximated  by  LQG  which  provides  a  reliable 
starting  solution.  The  continuation  parameter  7  is  then  successively  decreased  until  either  a  desired 
value  of  7  is  achieved  or  no  further  decrease  is  possible.  This  algorithm  is  now  summarized.  Let 
e  >  0  denote  a  convergence  criterion. 

Algorithm  8.1.  To  solve  (3.7),  (3.14)  and  (3.15),  perform  the  following  steps: 

Step  1:  Initialize  7  >  0; 

Step  2:  Solve  (3.7)  for  Q\ 

Step  3:  Let  k  —  0,Qo  =  Q-, 

Step  4:  Solve  (3.14)  for  Pk+i  =  P  with  Q  =  Qk) 

Step  5:  Solve  (3.15)  for  Qk+i  =  Q  with  P  =  Pk+i\ 

Step  6:  If  k  >  1  check  for  ||P*+i  -  P*||  <  e  and  \\Qk+i  -  Qk||  <  e; 

Step  7:  If  convergence  is  not  achieved  in  Step  6  (or  k  =  0)  let  k  ♦—  k  +  1  and  go  to  Step  4; 

otherwise  decrease  7  and  go  to  Step  2. 

Steps  2,  4  and  5  were  carried  out  using  a  standard  Riccati  solver  [37]  which  proved  to  be 
reliable  even  when  the  quadratic  term  was  indefinite  or  nonnegative  definite.  For  instance,  for  the 
example  considered  below  the  term  7~af?i  —  £  was  indefinite  for  all  finite  7.  The  crucial  step  in 
the  algorithm  is  the  decreasing  of  7  in  Step  7.  Significant  effort  was  devoted  to  providing  a  smooth 
transition  to  smaller  values  of  7  without  sacrificing  computational  efficiency.  The  development  of 
more  sophisticated  continuation  algorithms  remains  an  area  for  future  research. 

The  example  considered  was  formulated  in  [38]  and  was  considered  extensively  in  [24,25,39]  to 
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compare  reduced-order  design  methods.  The  example  is  interesting  since  it  possesses  a  complex 
pair  of  nonminimum  phase  zeros  due  to  the  fact  that  the  physical  system  (coupled  rotating  disks) 
has  noncolocated  sensors  and  actuators.  The  plant  is  of  eighth  order  and  has  two  neutrally  stable 
poles.  The  problem  data  are  as  follows: 

n  =  ne  =  8,  m  =  i  —  1,  q  =  p  —  2, 


-0.161  1  0  0  0  0  0  0- 

-6.004  0  1  0  0  0  0  0 

-0.5822  0  0  1  0  0  0  0 

-9.9835  0  0  0  1  0  0  0 

-0.4073  0  0  0  0  1  0  0 

-3.982  0  0  0  0  0  1  0 

0  0000001 

0  000000  0. 


•  0  ' 
0 

.0064 
.00235 
.0713 
1.0002 
.1045 
.  .9955  . 


C  =  [1  Ojx  7  ] 


Ei  —  Eioo  —  10 


_  n_s  0  0  0  0  .55  11  1.32  18 


- 

“  [lj  ’ 


0  0  0  0 


Eioo  — 


£  =  0, 


Ei  =  [B  0gxl],  Di  =  [0  1). 

With  the  problem  data  as  given,  the  LQG  controller  was  found  to  yield  a  closed-loop  Hoo 
performance  of  1.39  (i.e.,  2.87  dB  above  unity  gain).  Using  Algorithm  8.1  we  obtained  a  solution 
for  7  =  .52  for  a  net  H0 0  performance  improvement  of  8.7  dB  (see  Figure  1).  Note  that  this 
result  is  consistent  with  Proposition  8.1  of  [3]  which  implies  that  the  maximum  ratio  of  the  H0 0 
performance  of  the  optimal  Lj  controller  to  the  H^  performance  of  the  optimal  Hoo  controller  can 
be  no  more  than  twice  the  number  of  right-half-plane  zeros,  which  for  the  present  problem  with 
two  nonminimum  phase  zeros  corresponds  to  a  factor  of  4  (i.e.,  12  dB). 

Our  numerical  experience  revealed  two  interesting  features.  First,  the  loop  between  Steps  4 
and  6  converged  reliably.  However,  a  critical  value  7mjn  of  7  was  invariably  found  below  which 
solutions  could  not  be  computed.  This  value  7mi„  appears  to  represent  the  best  achievable  Hoo 
performance  for  the  given  Li  weights.  Second,  for  each  value  of  7  >  7min  for  which  a  solution 


1 


was  computed,  the  actual  Hoo  performance  was  close  to  this  value  revealing  that  the  Hoo  bound 
is  tight.  For  example,  the  actual  worst-case  attenuation  of  the  7  =  .52  design  shown  in  Figure  1 
is  .511.  Controller  characteristics  are  given  in  Table  1.  Note  that  in  each  case  the  Lj  performance 
bound  is  within  30%  of  the  actual  Lj  performance. 


Hoo  Attenuation 

Actual  Hoo 

Lj  Performance 

Actual  L2 

Constraint  7 

Attenuation 

Bound 

Performance 

\\H{s)\\oo 

J(Ae,Bc,Ce,  Q) 

J{Ac,Bc,Cc) 

00  (LQG) 

1.39 

— 

.143 

2 

1.18 

.159 

.146 

1.5 

1.06 

.171 

.151 

1.0 

.855 

.204 

.168 

.9 

.797 

.217 

.176 

.8 

.732 

.236 

.187 

.7 

.661 

.262 

.203 

.52 

.511 

.299 

.262 

Table  1 
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Appendix  A:  Proof  of  Theorem  6.1 

To  optimize  (2.20)  over  the  open  set  X  subject  to  the  constraint  (2.14),  form  the  Lagrangian 
£ {Ae,  Be,Ce,  Q,P,  A)  =  tr{A2R  +  [AQ  +  QAT  +  TiQR00Q  +  V]P},  (A.l) 

where  the  Lagrange  multipliers  A  >  0  and  P  €  IRnXn  are  not  both  zero.  We  thus  obtain 

f|  =  (A  +  7"a  QRco)TP  +  P{A  +  7'*  QRoo)  +  A  R.  (A.2) 
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-60.0 


Setting  dC/dQ  =  0  yields 


0  =  (A  +  i-'QRoofP  +  P(A  +  ^~2QRco)  +  A  R.  (A.3) 

Since  A+~i~2  QR0 0  is  assumed  to  be  stable,  A  =  0  implies  P  —  0.  Hence,  it  can  be  assumed  without 
loss  of  generality  that  A  =  1.  Furthermore,  P  is  nonnegative  definite. 


Now  partition  n  x  n  Q,P  into  n  x  n,  n  x  ne,  and  ne  x  ne  subblocks  as 


Q 12 
Qi  . 


'Pi  Pl2 
.  P\2  Pi  .  ‘ 


Thus,  with  A  =  1  the  stationarity  conditions  are  given  by 


~  =  (A  +  ^QR^fP  +  P{A  +  T'QRoo)  +  R  =  0, 

3  p 

'qa~  —  PihQu  +  PiQi  —  0, 

=  p2bcv2  +  [P^QX  +  P2Ql2)CT  =  0, 
d  £, 

—  R-iCcQ*  +  P2i~2  RzCciPiQu  +  P\iQi)TQi7  +  BT(PiQi2  +  P12Q2)  =  0. 


(A.4) 


(A.5) 

(A.6) 


(A.7) 


Expanding  (2.14)  and  (A.4)  yields 


0  =  AQi  +  QzAr  +  BCcQ^  +  QnCj  BT  +  7_2Qi^iooQi 

+  /?  VJQi2CeT  RiCcQ^  +  Vu  (A.8) 

0  =  AQx2  +  Q12AJ  +  BCeQ2  +  QXCTB f  +  7-2  Q  i^iooQ  12 

+  ^J7'S<3i2CeTi?2Ceg2,  (A.9) 

0  =  Aeg2  +  g2  aJ  +  pccgl2  +  q?2ctb?  +  7-2<?f2*iooQi2  • 

+  P2l~2QiCj  R2CeQ2  +  BcVjBj ,  (A.10) 

0  =  ArPz  +  PZA  +  CTBj  P*  +  PuBeC  +  T'RiooiPiQx  +  PZ2gfa)T 

+  7~3(PiQi  +  Pi2Qi2)Bioo  +  Bi,  (A-ll) 

0  =  AtP13  +  P12Ae  +  CrSerP2  +  PxBCe  +  7_2i2ioo(Pir2Qi  +  P2Qf2)r 

+  ^27_2(PiQi2  +  Pi2Q2)C'JP2Ce,  (A.12) 

0  =  AjP2  +  P3Ae  +  PxiBCe  +  CjBTP12  +  CjR2Ce.  (A.13) 
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Lemma  A.l.  Q 2  and  P2  are  positive  definite. 


Proof.  By  a  minor  extension  of  results  from  [40],  (A.  10)  can  be  rewritten  as 
0  =  (Ae  +  BcCQuQt)Qi  +  QMo  +  BcCQuQt)T  +  *, 

where 

*  =  -t-'QliRiooQu  +  Ph-'QiCj  r2ccq2  +  bcv2bJ 

and  QJ  is  the  Moore-Penrose  or  Drazin  generalized  inverse  of  Q 2.  Next  note  that  since  (AC,BC)  is 
controllable  it  follows  from  Lemma  2.1  and  Theorem  3.6  of  [28]  that  ( Ae  +  BcCQ12Qt >  ^  is  also 
controllable.  Now,  since  Q2  and  $  are  nonnegative  definite,  Lemma  12.2  of  [28]  implies  that  Q2  is 


positive  definite.  Using  (A.  13),  similar  arguments  show  that  P2  is  positive  definite.  □ 

Since  R2,V2,Q2,  P2  are  invertible,  (A.5)-(A.7)  can  be  written  as 

-Pf'PnQuQt1  =  In. ,  (A.  14) 

Be  =  -PfHPuQi  +  P*Qn)CTVfl,  (A.15) 

Ce[ln.  +  +  Q2p?2)QnQ21]  =  -R21BT(PlQl2  +  P12Q2)Q21.  (A.16) 


Now  define  the  n  x  n  matrices 

Q  =  Qi  -  QhQ^QL,  P  =  Pi-  PizP^PL, 

Q  =  QuQt'Qli,  P  =  PizP2lP^ 

r  =  -Qi2Q2tPi1Pi2, 

and  the  nc  x  n,  n„  x  ne  and  nc  x  n  matrices 

G  =  Q2lQ t12,  m±q2p2,  r  =  -Pf1Pi2. 

Note  that  r  =  GtT. 

Clearly,  Q,P,Q  and  P  are  symmetric  and  Q  and  P  are  nonnegative  definite.  To  show  that  Q 
and  P  are  also  nonnegative  definite,  note  that  Q  is  the  upper  left-hand  block  of  the  nonnegative- 
definite  matrix  Q.Q.QT ,  where 

Q  A  In  —Q12Q2  1 

[On.  xn  In. 

Similarly,  P  is  nonnegative  definite. 
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Next  note  that  with  the  above  definitions  (A.14)  is  equivalent  to  (6.2)  and  that  (6.1)  holds. 
Hence  r  =  GtT  is  idempotent,  i.e.,  r2  =  r. 


It  is  helpful  to  note  the  identities 

q  =  QUG  =  gtq*2  =  gtq2g,  p  =  -p12r  =  -rTp*  =  rTp2r, 

tGt  =  Gt,  TV  =  r, 

Q  =  tQ,  P  =  Pt, 

QP=-Qi2P?2. 

Using  (A.14)  and  Sylvester’s  inequality,  it  follows  that 


(A.17) 

(A.18) 
(A.  19) 
(A. 20) 


rank  G  =  rank  T  =  rank  Qi2  =  rank  P22  =  ne. 

Now  using  (A.17)  and  Sylvester’s  inequality  yields 

ne  =  rank  Qu+  rank  G  —  n„  <  rank  Q  <  rank  Q i2  =  nC) 
which  implies  that  rank  Q  =  ne.  Similarly,  rank  P  =  ne,  and  rank  QP  —  nc  follows  from  (A.20). 


The  components  of  Q  and  P  can  be  written  in  terms  of  Q,  P,  Q,  P,G  and  T  as 

Ql=Q  +  Q,  Pi  =  P-rP, 

Qii  =  QrT,  Pi2  =  -pgt, 
q2  =  rQrT ,  p2  =  gpgt. 


(A.21) 
(A. 22) 
(A.23) 


Next  note  that  by  using  (A.21)-(A.23)  it  can  be  shown  that  the  right-hand  coefficient  of  Ce  in 
(A.  16)  is  given  by 

S  ±  In.+02-f-,rQPGT. 

To  prove  that  S  is  invertible  use  (A. 19)  and  (6.3)  and  note  that 

In.+P1!  ~3rQPGT  =  In,+021~irQrTPGT 

=  in,  +  /3i't~,{rQrT){GPGT). 

Since  rQTT  and  GPGT  are  nonnegative  definite,  their  product  has  nonnegative  eigenvalues  (see 
Lemma  5.1).  Thus  each  eigenvalue  of  /n>  +  P2*/'2 TQPGt  is  real  and  is  greater  than  unity.  Hence 
S  is  invertible.  Now  note  that  by  using  (6.2)  and  (6.3)  it  can  be  shown  that 

GTS~1r  =  St. 
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The  expressions  (6.11),  (6.12)  and  (6.13)  follow  from  (A.15),  (A.16),  and  the  definition  of  Q.  Next, 
computing  either  P(A.9)-(A.10)  or  G(A.12)+(A.13)  yields  (6.10).  Substituting  (A.21)-(A.23)  into 
(A.8)-(A.13)  and  the  expression  for  Ae  into  (A.9),  (A.10),  (A.12)  and  (A.13)  it  follows  that  (A. 10) 
=  P(A.9)  and  (A.13)  =  G(A.12).  Thus,  (A. 10)  and  (A.13)  are  superfluous  and  can  be  omitted. 


Thus,  (A.8)-(A.13)  reduce  to 

0  =  AQ  +  qat  +  Vk  +  7 -\Q  +  Q)^ioo(g  +  Q)  +  Pi  ~2QStpepsq 

+  (A-  ZPS)Q  +  Q(A-  2PS)t,  (A.24) 

0  =  [(A  -  2PS)Q  +  Q(A  -  ZPS)T  +  QZQ  +  7 ~2{Q  +  Q)Pi<»(Q  +  Q)  -  l'2QRiooQ 

+  pl -*QSTPZPSQ\rT,  (A.25) 

0  =  (A  +  7 '7[Q  +  Q]Rioo)TP  +  P(A  +  7 ~2[Q  +  Q]i?ioo)  +  Ri 

+  (A  -  Q2  +  i'*QRioo)TP  +  P(A  -QS  +  i-2QRioo),  (A.26) 

0  =  [(A  -  QS  +  i-2QR1oo)TP  +  P{A  -Q2  +  i^QRioo)  +  STP£PS]GT.  (A.27) 


Next,  using  (A.24)+GTr(A.25)G-(A.25)G-[(A.25)G]T  and  GTr(A.25)G-(A.25)G-[(A.25)G]T 
yields  (6.5)  and  (6.7).  Similarly,  using  (A.26)+PrG(A.27)P-(A.27)r-[(A.27)r]r  and 
rTG(A.27)P-(A.27)P-[(A.27)r]T  yields  (6.6)  and  (6.8). 

Finally,  to  prove  the  converse  we  use  (6.5)-(6.13)  to  obtain  (2.14)  and  (A.4)-(A.7).  Let 
Ae,  Be,Ce,G,  r,r,Q,P,Q,P,  Q  be  as  in  the  statement  of  Theorem  6.1  and  define  Qi,Qi2,Q2, 
Pi,Pi2,Pi  by  (A.21)-(A.23).  Using  (6.2),  (6.11)  and  (6.12)  it  is  easy  to  verify  (A.6)  and  (A. 7). 
Finally,  substitute  the  definitions  of  Q,  P,  Q,  P,  G,  P,  and  r  into  (6.5)-(6.8)  using  (6.2),  (6.3), 
and  (A.  19)  to  obtain  (2.14)  and  (A.4).  Finally,  note  that 

Q[in  rT  1, 

which  shows  that  Q  >  0.  □ 


Q  = 


Q 

[On.  Xn 


+ 
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Abstract 

In  a  recent  paper  a  unification  of  the  L2  (LQG ) 
and  Hoo  control  design  problems  was  obtained  in  terms  of 
modified  algebraic  Riccati  equations.  In  the  present 
paper  these  results  are  extended  to  guarantee  robust  I2 
and  Hoo  performance  in  the  presence  of  structured  real¬ 
valued  parameter  variations  (AA,  AB,  AC)  in  the  state 
space  model.  For  design  flexibility  the  paper  con¬ 
siders  two  distinct  types  of  uncertainty  bounds  for 
both  full-  and  reduced- order  dynamic  compensation.  An 
important  special  case  of  these  results  generates  Li /Hoo 
controller  designs  with  guaranteed  gain  margins. 


I.  Introduction 

It  has  recently  been  shown  that  the  solution  to 
the  optimal  Hoo  disturbance  attenuation  problem  can  be 
expressed  in  terms  of  a  pair  of  modified  Riccati  equa¬ 
tions  ([1,2]).  Furthermore,  it  was  shown  in  [1]  that 
Li /Hoo  design  tradeoffs  can  be  achieved  by  solving  a 
coupled  system  consisting  of  three  modified  Riccati 
equations.  As  is  well  known,  the  disturbance  attenua¬ 
tion  problem  can  be  used  to  guarantee  robustness  with 
respect  to  unstructured  plant  uncertainties.  However, 
if  plant  uncertainty  is  present  in  the  form  of  para¬ 
metric  variations  of  the  state  space  model,  then  alter¬ 
native  bounding  techniques  are  required.  The  goal  of 
the  present  paper  is  thus  to  extend  the  results  of  [l] 
to  include  bounds  on  the  effect  of  real- valued  struc¬ 
tured  parameter  variations. 

In  the  absence  of  an  Hx  design  constraint,  robust 
stability  and  Li  performance  for  dynamic  compensator 
design  were  guaranteed  in  [3.4]  by  incorporating  quad¬ 
ratic  Lyapunov  bounds  within  LQG  design  theory.  Two 
distinct  bounds  were  considered.  In  [3]  a  quadratic 
bound  was  used  while  in  [4]  a  linear  bound  was  em¬ 
ployed.  In  each  case  full-  and  reduced-order  dynamic 
compensators  were  characterized  by  means  of  coupled 
systems  of  modified  Riccati  and  Lyapunov  equations. 

To  design  Hoo  controllers  which  are  robust  with  re¬ 
spect  to  structured  real- valued  parameter  variations  we 
proceed  by  combining  the  results  of  [1]  with  those  of 
T3.4] .  That  is,  we  derive  coupled  systems  of  modified 
Riccati  and  Lvapunov  equations  whose  solutions  yield 
controllers  which  are  guaranteed  to  satisfy  a  prespeci¬ 
fied  Hoo  attenuation  constraint  for  all  variations  (AA, 
AB,  AC)  belonging  to  a  given  uncertainty  set.  If  the 
uncertainty  is  absent  (i.e.,  AA  =  0,  etc.)  then  the  re¬ 
sults  of  r 1]  are  recovered,  while  if  the  H»  constraint 
is  relaxed,  then  the  results  of  [3.4]  are  obtained. 

Thus  the  results  of  [l]  can  be  viewed  as  a  specializa¬ 
tion  of  a  broader  design  theory  which  accounts  for 
structured  real- valued  parameter  uncertainty.  Finally, 
we  state  all  results  for  the  case  of  a  fixed-order 
(i.e.,  reduced- order)  controller  for  maximal  design 


*  This  work  is  sponsored  by  the  Dept,  of  the  Air 
Force.  The  views  expressed’ are  those  of  the  author  and 
do  not  reflect  the  official  policy  or  position  of  the 
U.S.  Government. 

**  Supported  in  part  by  the  Air  Force  Office  of 
Scientific  Research  under  contract  F49620-86-C-0002. 


flexibility.  Extensions  to  even  more  general  design 
problems  are  mentioned  in  Section  9  but  omitted  here 
for  lack  of  space. 

Notation.  Note:  All  matrices  have  real  entries. 

R,  Rrlts,  Rr ,  E  real  numbers,  r  x  s  real  matrices, 
iRrxl,  expected  value 

Ir ,  ()T,  Or xs »  0r  r  x  r  identity  matrix,  transpose. 

r  x  s  zero  matrix,  0rXr 


Sr  ,INr  ,IPr 

Z,  <  Zi ,  Z(  <  Z2 

n,m,f,ns 
p,doD,q,q»;  ii 

x.u,y,xc,x 
A,AA;  B,AB;  C.AC 
Ac .  Be ,  Cc 

x.  A,  AA 
*•(•) 
n, .  Di 

V,  .  Vi 

D.  V 

Ei  ,  Ei 


r  x  r  symmetric,  nonnegative  defi¬ 
nite,  positive- definite  matrices 

Z2  -  L\  e  «r ,  Z2  -  Z,  t  9>r, 

1\  ;  Zi  c  Sr 

positive  integers 

positive  integers;  n  +  nc  (nc  <  n) 

n,m,f,nc,  ii- dimensional  vectors 
nxn;nxm;  fxn  matrices 
nc  x  nc ,  nc  x  i ,  m  x  nc  matrices 


[x 

A  BCc 

AA 

ABCcl 

xc. 

, 

QcC  Ac. 

Bc  AC 

0 

d- dimensional  standard  white  noise 
n  x  d.  (  x  d  matrices:  D,Dj  =  0 

D,D[,  DjDj:  Vi  e  f( 


D«  ’ 

Onxnc 

Bc 

.0ncxn  V  2  Bc 

1  x  n.  q 

x  m  matrices; 

E,  R|  .  R2 

R 

E|  x <  E'2 x 


Ex ,  Rj  oc,  Rj® 
Roo 


[E,  E2Cc] .  E[E, .  EjE2  ;  R,  £ 
’  Ri 

.0ncxn 

qx  x  n.  qx  x  m  matrices; 
E]”xE2x  -  0 


0  n  x  n  c 

CchCc 


=  ete 


[EjOO  E2xCc]  .  E/xEjX,  E2xE2x 

Rl  30  Onxnc 
Oficxn  CcRoxCc. 


=  Ex  Ex 


D|«,  D2® 
Vj®,  V2® 


D® ,  V® 


7,  a 


n  x  d®,  l  x  d®  matrices;  D,®D2®  =  0 

D,®^®,  DjOcDjOO 


Vi«  Onxnc 
.flncxn  BcV2ocBc 


Di® 

BcD2® 

» 

nonnegative  constant;  positive 
constants 


(iii)  the  performance  functional 

J(Ac,Bc>Cc)  =  sup  1  im  sup 

(AA,  AB,  AC)eU  t  —  oo 

E[xT(t)Ri x(t)  +  uT(t)R2u(t)]  (2.7) 

is  minimized. 

Note  that  for  each  uncertain  variation  (AA,  AB, 
AC)  e  U,  the  closed- loop  system  can  be  written  as 


A  Ac  A  +  -  I„,  Ac  +  2  I„. 

u  u  2  2 


II.  Robust.  Stability  and  U  Performance  with 
a  Robust  Hop  Constraint 

In  this  section  we  state  the  Robust  stability  and 
L2  performance  problem  with  robust  Hoc  disturbance"  at¬ 
tenuation  constraint.  Specifically,  we  consider  a 
fixed-order  dynamic  output- feedback  control- design 
problem  with  structured  real- valued  plant  parameter 
uncertainties  and  constrained  Hoo  disturbance  attenua¬ 
tion.  This  problem  involves  a  set  U  c  Rnxn  x  IRnxm  x 
IRtxm  of  uncertain  perturbations  (AA,  AB,  AC)  of  the 
nominal  system  matrices  (A,  B,  C).  The  goal  of  the 
problem  is  to  determine  a  fixed- order,  strictiv  proper 
dynamic  compensator  (Ac,  Bc ,  Cc)  which  (a)  stabilizes 
tlie  plant  for  all  variations  in  U,  (b)  satisfies  an  H» 
constraint  on  disturbance  rejection  for  all  variations 
in  U,  and  (c)  minimizes  the  worst- case  value  over  the 
uncertainty  set  U  of  a  steady- state  Lo  performance  cri¬ 
terion.  In  this  and  the  following  section  no  explicit 
structure  is  assumed  for  the  elements  of  U.  In  Sec¬ 
tions  4  and  7,  two  specific  structures  of  variations  in 
U  will  be  introduced. 

Hoc  -  Constrained  Robust  Dynamic  Comnensation  Pro¬ 
blem. Given  the  nth-order  staoilizable  and  detectable 
plant  with  structured  real- valued  plant  parameter  var¬ 


iations 

x(t)  -  (A  +  AA)x(t)  ♦  (B  +  AB)u(t)  ♦  D,w(t).  (2.1) 

y(t)  =  (C  +  AC)x(t)  +  Diw(t).  (2.2) 

determine  an  ncth-order  dynamic  compensator 

xc(t)  =  Acxc(t)  +  Bcy(t)  (2.3) 

u ( t )  =  Ccxc (t) ,  (2.4) 


which  satisfies  the  following  design  criteria: 

(i)  the  closed- loop  system  (2.1)  -  (2.4)  is  asymptot¬ 
ically  stable  for  all  (AA.  AB,  AC)  e  U  ,  i.e..  A  +  AA 
is  asymptotically  stable  for  all  (AA,  AB.  AC)  e  U: 

(ii)  the  q*  x  d  closed- loop  transfer  function 

llAj(s)  £  EJsI-  -  (A  ♦  AA))-‘D,  (2.5) 

from  w(t)  to  Ei*x(t)  +  E-2xu(t)  satisfies  the  con¬ 
straint 

i|iy(s)||®  <  7,  (AA,  AB,  AC)eU,  (2.6) 


x(t)  =  (A  +  AA)x(t)  +  Dw(t),  te[0.®),  (2.8) 

and  that  (2.7)  becomes 

J(Ac,Bc,Cc)  =  sup  lim  sup 

(AA,  AB,  AC)eU  t  —  » 

E[xT ( t )Rx( t )] .  (2.9) 

Note  that  the  problem  statement  involves  both  Lj 
and  H®  performance  weights.  In  particular,  the  matri¬ 
ces  Ri  and  Ro  are  the  Lt  weights  for  the  state  and  con¬ 
trol  variables.  By  introducing  the  variables 

z(t)  =  Eix(t),  v(t)  =  Eouft). 

the  cost  (2.7)  can  be  written  as 

J(AC,  Bc,  Cc)  =  sup  lim  sup 

(AA,  AB,  AC) ell  t  —  ® 

E[zT(t)z(t)  +  vT(t)v(t)]. 

For  convenience  we  thus  define  R,  =  E[E,  and  R2  =  E2Ei 
which  appear  in  subsequent  expressions.  Although  an  Lj 

cross- weighting  term  of  the  form  2xT(t)R12U(t)  can  also 
be  included,  we  shall  not  do  so  here  to  facilitate  the 
presentation. 

For  the  Hx  performance  constraint,  the  transfer 
function  (2.5)  involves  weighting  matrices  E,®  and  E2x 

for  the  state  and  control  variables.  The  matrices  Rj® 

=  E,»  E,®  and  R2®  =  E2®  E2x  are  thus  the  Hx  counter¬ 
parts  of  the  Lo  weights  Ri  and  .  Although  we  do  not 
require  that  Ri®  and  R>x  be  equal  to  Rj  ana  Rt  .  we 
shall  require  that  R2®  =  fiRt.  where  the  nonnegative 

scalar  3  is  a  design  variable.  We  further  note  that 
the  assumption  E,xE2®  =  0  precludes  an  H®  cross- 

weighting  term  which  again  facilitates  the  presenta¬ 
tion.  Finally,  similar  remarks  apply  to  the  distur¬ 
bance  and  sensor  noise  intensities  Vj  =  D,D[.  V2  = 

D,DJ,  V,  =  D,  D,t  and  V2  =  D2  D2T  for  the  it  and  B® 

l  l  1®  1  ®  1  x  ‘x  ‘x  ‘X 

designs  respectively.  We  note  that  w(t)  can  be  inter¬ 
preted  as  white  noise  for  the  L2  design  aspect  and  as 
an  Li  signal  for  the  Hx  design  aspect  [1]. 

Before  continuing  it  is  useful  to  note  that  if 

(A  +  AA)  is  asymptotically  stable  for  all  (AA.  AB.  AC) 
t  U  for  a  given  compensator  (Ac.  Bc ,  Cc)  then  the  per¬ 
formance  (2.7)  is  given  by 


where  7  >  0  is  a  given  constant;  and 


J(Ac)  Be,  Cc )  =  sup  tr  QAAR,  (2.10) 

(AA,  AB,  AC)eU 

where  the  steady- state  closed- loop  state  covariance  de¬ 
fined  by 

0^  ~  1«  E[x(t)x(t)] ,  (2.11) 


satisfies  the  ii  x  n  algebraic  Lyapunov  equation 

0  =  (A  ♦  AA)0Ai  ♦  QaA(A  ♦  AA)t  ♦  V.  (2.12) 

The  key  step  in  guaranteeing  robust  stability  and 
performance  is  to  replace  the  uncertain  terms  in  the 
covariance  Lyapunov  equation  (2.12)  by  a  bounding  func¬ 
tion  Q.  Note  that  since  AA  is  independent  of  Ac,  the 
bounding  function  ft  need  only  depend  on  Bc  and  Cc . 
Furthermore,  the  H®  constraint  (2.6)  on  the  disturbance 
attenuation  is  enforced  for  all  (AA,  AB,  AC)  e  U  by  re¬ 
placing  the  modified  algebraic  Lyapunov  equation  (2.12) 
by  an  algebraic  Riccati  equation  which  overbounds  the 
closed- loop  steady- state  covariance.  Justification  for 
this  technique  is  provided  by  the  following  result. 


Lemma  2.1.  Let  ft:  !Rncx/  x  R“!",c  x  IN"  —  S"  be 
such  that 

AAQ  +  QAAt  <  ft(Bc,  Cc,  Q) ;  (AA,  AB,  AC)eU, 

(Be,  Cc,  Q)elRnc**x  rxnc  x  NS,  (2.13) 

and,  for  a  given  (Ac,  Bc,  Cc),  suppose  there  exists 
q  c  IN"  satisfying 

o  =  aq  +  qF  +  r2qM  +  fl(Bc,  cc,  q)  +  v,  (2. 14) 

then 

(A  +  aa,  [v  +  7‘2qM  +  ft(Bc,  cc,  q)  -(aaq  +  qA.iT)]i) 

is  stabilizable  for  all  (AA,  AB,  AC)eU.  (2.15) 

if  and  only  if 

A  +  AA  is  asymptotically  stable,  (AA,  AB,  AC)eU  (2.16) 
In  this  case, 

Paa(s)II»  <  T,  (AA,  AB,  AC)eU,  (2.17) 

and 

Qaa  <  q,  (AA,  AB,  AC)eU,  (2.18) 

where  QAA  is  given  by  (2.12).  Consequently, 

J(AC.  Bc,  Cc)  <  J(Ac,  Bc,  Cc.  q),  (2.19) 

where 

J(AC,  Bc.  Cc,  q)  =  tr  qR.  (2.20) 

Proof.  First  note  for  clarity  that  in  (2.13)  q 

denotes  an  arbitrary  element  of  IN"  since  (2.13)  holds 
for  all  q  t  IN",  while  in  (2.14)  q  donotes  a  specific 


solution  to  (2.14).  Now  for  (AA,  AB,  AC)  e  U,  (2.14) 
is  equivalent  to 

o  =  (A  +  AA)q  +  qca  +  aa)t  +  r2  QM 

+  ft(Bc,  cc,  q)  -  (aaq  +  qAAT)  ♦  v.  (2. 21) 

Hence,  by  assumption,  (2.21)  has  a  solution  q  t  IN"  for 
all  (AA,  AB,  AC)  e  U  and,  by  (2.13),  ft  (Bc,  Cc ,  q) 

- (AAQ  +.qAAT)  is  nonnegative  definite.  Now  if  the  sta- 
bilizability  condition  (2.15)  holds  for  all  (AA,  AB, 

AC)  e  U,  it  follows  from  Lemma  12.2  of  [5]  that  i  +  AA 
is  asymptotically  stable  for  all  (AA.  AB,  AC)  c  U. 

Conversely,  if  A  +  AA  is  asymptotically  stable  for  all 
(AA,  AB,  AC)  e  U,  then  (2.15)  holds.  The  proof  of 
(2.17)  now  follows  from  a  standard  manipulation  of 

(2.14).  Next,  subtracting  (2.12)  from  (2.20)  yields 

0  =  (A  ♦  aa) (q  -qAA)  +  (q  -qaa)(a  +  aa)t  +  r2qM 
+  ft  (Be ,  Cc ,  q)  - (AAQ  +  qAAT) , 

or,  equivalently,  since  A  +  AA  is  asymptotically  stable 
for  all  (AA,  AB,  AC)  e  U, 

Q  -Q*a  V®  e(A  +  AA)t  [r2  q  Rx  q  +  ft  (Be,  cc,  qj 
- (AAQ  +  qAAT)]e(i  +  Ai)Tt  dt  >  0 

which  implies  (2.18).  The  performance  bound  (2.19)  is 
now  an  immediate  consequence  of  (2.18).  o 

Remark  2.2.  Note  that  (2.15)  is  actually  a 
closed- loop  "disturbability"  condition  which  is  not 
concerned  with  control-as  such.  This  condition  guaran¬ 
tees  that  the  closed- loop  system  does  not  possess  un¬ 
stable  undisturbed  modes.  In  applying  Lemma  2.1  it  may¬ 
be  convenient  to  replace  condition  (2.15)  with  a 
stronger  condition  which  is  easier  to  verify  in  prac¬ 
tice.  Clearly.  (2.15)  is  satisfied  if  [V  +  y'2  QllacQ 

+  ft  (Bc,  Cc.  q)  - (AA  q  +  q  AAt)]  is  positive  definite 
for  all  (AA.  AB,  AC)  e  U.  This  will  be  the  case,  for 

example,  if  either  V  is  positive  definite  or  strict  in¬ 
equality  holds  in  (2.13).  Also,  it  follows  from  Theo¬ 
rem  3.6  of  [5]  that  (2.15)  is  implied  by  the  stronger 
condition  that 

(A  +  AA.  D)  is  stabilizable.  (AA,  AB.  AC)eU.  (2.22) 


III .  The  Auxiliary  Minimization  Problem 

As  shown  in  the  previous  section,  the  replacement 
of  (2.12)  by  (2.14)  enforces  the  H®  disturbance  atten¬ 
uation  constraint  and  yields  an  upper  bound  for  the 
worst  case  Lj  performance  criterion.  That  is,  given  a 
compensator  (Ac,  Bc ,  Cc)  for  which  there  exists  a  non- 
negative-  definite  solution  to  (2.14),  the  actual  worst 
case  L2  performance  (Ac.  Bc,  Cc)  of  the  compensator  is 
uaranteed  to  be  no  worse  than  the  bound  given  by 
(Ac,  Bc,  Cc,  Q).  Hence,  J  (Ac,  Bc ,  Cc.  q)  can  be  in¬ 
terpreted  as  an  auxiliary  cost  which  leads  to  the  fol¬ 
lowing  optimization  problem. 

Auxiliary  Minimization  Problem.  Determine  (Ac, 

Be,  Cc,  Q)  which  minimizes  J  (Ac.  Bc ,  Cc .  Q)  subject  to 

(2.14)  with  Q  e  IN". 

It  follows  from  Lemma  2.1  that  the  satisfaction  of 

(2.14)  for  Q  t  N"  along  with  the  generic  condition 


(2.15)  leads  to  1)  closed- loop  stability  for  all  (AA, 
AB,  AC)  e  U;  2)  prespecified  H®  performance  attenuation 
for  all  (AA,  AB,  AC)  e  U;  and  3)  an  upper  bound  for  the 
worst  case  Li  performance  criterion,  lienee,  it  remains 
to  determine  (Ac,  8C,  Cc)  which  minimizes  J  (Ac,  Bc, 

Cc,  Q)  and  thus  provides  an  optimized  bound  for  the  ac¬ 
tual  worst  case  L2  performance  J  (Ac,  Bc,  Cc)  over  all 
(AA,  AB,  AC)  £  U. 


Having  established  the  theoretical  basis  for  our 
approach,  we  now  assign  explicit  structure  to  the  set  U 
and  bounding  function  ft.  Specifically,  the  uncertainty 
set  U  is  assumed  to  be  of  the  form 

U  =  {(AA,  AB,  AC):  AA  =  S  Ai ,  AB  =  £  jjBj, 

i  *  I  i  *  1 

AC  =  £  oq  Cj ,  £  <r?/n?  <  1},  (4.1) 

i  *  1  i  *  1 

where,  for  i  =  1,  ...»  p:  A$  e  IRnitn,  B,  e  Rnx“,  and  Ci 
£  are  fixed  matrices  denoting  the  structure  of  the 

parametric  uncertainty;  Oj  is  a  given  positive  number; 
and  <r;  is  an  uncertain  real  parameter.  Note  that  the 
uncertain  parameters  a\  are  assumed  to  lie  in  a  speci¬ 
fied  ellipsoidal  region  in  IRP.  The  closed- loop  system 
(2.8)  thus  has  structured  uncertainty  of  the  form 

AA  =  £  A; ,  (4.2) 

i  *  1 


.  »  A  ■,  B  i  Cc 

A;  =  ;  i  =  1.  ...,  p- 


Note  that  the  symmetry  of  the  uncertainty  set  entails 
no  loss  of  generality  by  requiring  only  a  redefinition 
of  the  nominal  plant  matrices. 

In  order  to  obtain  explicit  gain  expressions  for 
(Ac.  Bc,  Cc)  in  Sections  5  and  6,  we  shall  require  that 
at  most  one  of  the  perturbations  AB  and  AC  is  nonzero. 
Ve  thus  consider  the  cases  (AA.  AC)  £  U  or  (AA,  AB)  £ 

U.  If  this  assumption  is  not  imposed,  then  optimality 
conditions  can  still  be  derived,  but  at  the  expense  of 
closed-form  gain  expressions.  In  this  section,  and 
Section  5  we  will  assume  that  AB  =  0  (i.e.,  B;  =  0,  i  = 
1,  ...,  p)  and  ft  (Bc,  Cc ,  Q)  becomes  ft  (Bc ,  Q).  The 
dual  case  AB  #  0,  AC  =  0  (i.e.,  C,  =0,  i  =  1,  ...,p) 
will  be  considered  in  Section  6. 

For  the  structure  of  U  specified  by  (4.1),  the 
bound  ft  satisfying  (2.13)  can  now  be  given  a  concrete 
form. 

Proposition  4.1.  Let  a  be  an  arbitrary  positive 
scalar.  Then  the  function 


right  shift  of  the  open- loop  dynamics.  The  second  term 
a'1  £  a2AiQAj  arises  naturallv  from  a  multiplicative 

i*l  1 

white  noise  model.  Such  interpretations  have  no  bear¬ 
ing  on  the  results  obtained  here  since,  only  the  bound 
ft  defined  by  (4.3)  is  required.  Ve  call  (4.3)  the 
1  in ear  bound  since  it  is  linear  in  Q.  For  a  more  de¬ 
tailed  discussion  on  (4.3)  see  [4]. 

With  ft  defined  by  (4.3),  the  modified  Riccati 
equation  (2.14)  becomes 

0  =  AQ  +  QAt  +  7-2QM  +  oQ  +  a  *  £  afiiQA[  +  V  (4.4) 

i s  l 

or,  equivalently, 

0  =  A  0  +  QA  T  +  r2  QM  +  £  MiQAl  +  V,  (4.5) 


where  Si  =  a\ /a  and 


Aft  4  A  +  -I - 

G  2  n 


BrC  Ac 


autticient  Conditions  tor  H 
and  Performance  with  Robust 
Attentuation:  Linear  Bound 


In  this  section  we  state  sufficient  conditions  for 
characterizing  fixed-order  (i.e.,  full-  and  reduced- 
order)  controllers  guaranteeing  closed- loop  stability 
for  all  (AA,  AC)  £  U,  constrained  H»  disturbance  atten¬ 
uation  for  all  (AA,  AC)  e  U,  and  an  optimized  worst 
case  Li  performance  bound. 

In  order  to  state  the  main  results  we  require  some 
additional  notation  and  a  factorization  lemma. 


Lemma  5.1.  Let  Q,  P  e  Wn  and  suppose  rank  QP  =  nc 
then  there  exist  nc  x  n  G,  T  and  nc  x  nc  invertible  M, 

unique  except  for  a  change  of  basis  in  (R"c .  such  that 


QP  =  GtMT,  TGt  =  I„c. 


Furthermore,  the  nxn  matrices 


r4cTr,  r^I„-r 


(5.1),  (5.2) 


(5.3),  (5.4) 


are  idempotent  and  rank  nc  and  n  -nc,  respectively. 
Finally,  if  P  e  INn  and  3  >  0  then  the  inverse 

S  k  (I„  +  ^7-2QP)->  (5. 


ft(Bc,  q)  4  Qq  +  a-1  £  o^Aiq.d 

i  *1  ' 


For  arbitrary  Q,  Q  e  Rnxn  and  a  >  0  define  the 
following  notation: 


satisfies  (2.13)  with  U  given  by  (4.1)  and  AB  =  0. 

Proof.  See  [4] .  □ 

Remark  4.1.  Note  that  the  bound  ft  given  by  (4.3) 
consists  of  two  distinct  terms.  The  first  term  aQ  can 
be  thought  of  as  arising  from  an  exponential  time 
weighting  of  the  cost,  or,  equivalently,  from  a  uniform 


v2 s  4  Vi  +  £  <5i Ci  (q  +  q)C[, 

i  *  1 

qs  =  qct  + 1  M<  (Q +  Q)c[.  s4br;'bt. 


Suppose  there  exist  Q,  P,  Q,  P  (  J» 


Theorem  5.1 
satisfying 

o  =  AaQ  «■  QA^  +  r2QRlaoQ  +  V, 

♦  s  <5»Ai  (Q  +  Q)A[  -QsV2;‘Qj  +  r  Qsv2-«QSV,  (5.6) 

i  *  l  A 

U  «  (Aa  *  ?  2 CQ  -  «]Rloo)TP  -  P(A.  -  r2[Q  -  fl]RI(#)  +  R. 
+  E  #i[A[PA,  ♦  (A,  -q.v2;1cl)TP(A,  -Qsv2-'Cj )] 

i  *  1 

-StPEPS  +  rTSTPEPSr  ,  (5.7) 

XX7  v  ' 

o  =  (A0  -eps  +  r2QR, JQ  +  Q(Att  -sps  ♦  r2 QRloo)T  + 
r*Q(R,.  +  ^sTPEPS)q  ♦  qfiv2^qj  (5.8) 

O  =  (Aa  -QsV.-'c  +  r2QRloo)TP  -  P(Aa  -Qsv2-'c 


+  r2QRiJ  +  STPEPS  -rVPEPSr^,  (5.9) 

rank  Q  =  rank  P  =  rank  Q  P  =  nc,  (5.10) 

and  let  (Ac,  Bc,  Cc,  Q)  be  given  by 

Ac  =  r(A  -EPS  -qsv2-'c  +  r2QR1(X,)GT  (5.n) 

Bc-rQ§V2l-‘,  (5.12) 

Cc  =  -Ri‘BTPSGT,  (5.13) 

Q  =  fq  >  q  qrT 
rq  rqrT 


Then.  (A  +  AA,  D)  is  stabilizable  if  and  onlv  if  A  +  AA 
is  asymptotically  stable  for  all  (AA,  AC)  e  l/.  In  this 
case,  the  closed- loop  transfer  function  «AA<  s)  satis¬ 
fies  the  Hx  disturbance  attenuation  constraint 


Remark  5.2.  To  specialize  Theorem  5.1  to  the  full 

order  case  nc  =  n,  it  is  only  necessary  to  set  GT  =  T1 
so  that  G  =  T  =  t  =  In  and  r  =  0  vithout  loss  of  gen¬ 
erality.  Now  the  last  term  in  each  of  (5.6)  -  (5.9) 
can  be  deleted  and  G  and  T  in  (5.11)  -  (5.14)  can  be 
taken  to  be  the  identity.  It  is  interesting  to  note 
that  in  the  full- order  case  the  Hx  design  problem  with 
structured  parameter  variations  is  comprised  of  four 
coupled  Riccat i/Lyapunov  equations.  Thi®  coupling 
illustrates  the  breakdown  of  regulator/estimator  sepa¬ 
ration  and  shows  that  the  certainty  equivalence  prin¬ 
ciple  is  no  longer  valid.  This  is  not  surprising  since 
separation  also  breaks  down  for  the  full- order  L2  re¬ 
sult  with  parameter  uncertainties  [4]. 

Remark  5.3.  When  solving  (5.6)  -  (5.10)  numeric¬ 
ally,  the  uncertainty  terms  and  the  Hx  constraint  can 
be  adjusted  to  examine  tradeoffs  among  performance, 
robustness,  and  disturbance  rejection.  Specifically, 
the  uncertainty  range  Oj  and  the  structure  matrices  Aj  , 
Cj  appearing  in  qs  and  V2s  along  with  7  can  be  varied 
systematically  to  determine  the  region  of  solvability 
of  the  design  equations  (5.6)  -  (5.9). 

Remark  5.4.  Although  equations  (5.6)  -  (5.10) 
appear  formidable,  they  are,  in  fact,  quite  numerically 
tractable.  For  related  problems  involving  coupled 
Riccat i  equations,  homotopic  continuation  methods  have 
been  shown  to  be  effective  (see  [1]  and  the  References 
therein) . 

Remark  5.5.  We  point  out  that  if  /?  =  0  or,  equiv¬ 
alently,  E2a)  =  0,  which  corresponds  to  the  "cheap"  Hx 

control  case  (i.e.,  Hx  attenuation  between  disturbances 
and  controls  is  not  constrained),  it  is  possible  to  ob¬ 
tain  closed- form  gains  (Ac,  Bc ,  Cc)  given  by  a  modified 
set  of  design  equations  when  all  three  of  AA,  AB,  and 
AC  are  nonzero.  Because  of  space  limitations  this  re¬ 
sult  will  be  given  in  a  future  paper. 

Rpmark  5.6.  An  important  special  case  of  the  re¬ 
sults  of  Section  5  is  obtained  by  setting  AA  =  0, 

AB  =  0,  AC  =  <J\  Cj  ,  and  Cj  =  C-  The  resulting  L2/Hx 
design  possesses  guaranteed  gain  margin  of  ±100<T[  per¬ 
cent  at  the  sensor  output. 


VI.  The  Dual  Case:  Linear  Bound 


1111^(3)11*  <  7,  (AA,  AC) eU,  (5.15) 

and  the  worst  case  l2  performance  criterion  (2.10) 
satisfies  the  bound 

J(AC,  Bc,  Cc)  <  tr[(q  +  Q)Ri  +  qSTPEPSq] .  (5.16) 

Proof .  The  proof  follows  from  Lemma  2.1  by  com¬ 
bining  the  proofs  of  Theorem  6.1  of  [1]  and  Theorem  6.1 
of  (4J.  o 

Remark  5.1.  Theorem  5.1  presents  sufficient  con¬ 
ditions  for  designing  controllers  yielding  robust  sta¬ 
bility  and  performance  with  a  constraint  on  the  Hx  norm 
of  the  closed- loop  transfer  function  for  a  state- space 
system  with  structured  real- valued  plant  parameter  var¬ 
iations.  These  sufficient  conditions  comprise  a  system 
of  three  modified  Riccati  equations  and  one  modified 
Lyapunov  equation  coupled  by  the  optimal  projection  r. 
the  linear  uncertainty  bound,  and  the  Hx  constraint. 

If  the  uncertainty  bound  is  deleted,  then  the  results 
of  [1]  are  recovered.  If,  alternatively,  the  uncer¬ 
tainty  terms  are  retained  but  the  Hx  constraint  is 
sufficiently  relaxed,  i.e.,  7  —  x,  then  the  results  of 
[4]  are  recovered  for  the  case  Bi  =  0,  i  =  1,  ...,  p. 


Unlike  the  standard  LqG  result  involving  a  pair  of 
uncoupled  Riccati  equations,  the  new  result  guarantee¬ 
ing  robust  stability,  robust  performance,  and  distur¬ 
bance  rejection- involves  a  coupled  system  of  four  modi¬ 
fied  Riccati/Lyapunov  equations.  The  asymmetry  of 
these  equations  suggests  the  possibility' of  a  dual  re¬ 
sult  in  which  the  modifications  to  the  standard  Riccati 
equations  are  reversed.  One  motivation  for  developing 
such  dual  results  is  that  for  certain  problems  the  dual 
bounds  may  be  sharper  than  the  primal  bound  introduced 
in  Section  4.  Furthermore,  the  dual  theory  permits 
distinct  Hx  disturbance  weights  (Vt  and  V2^) ,  although 

we  now  requre  =  R2 .  Finally,  the  dual  theory 

allows  for  uncertainty  in  the  control  matrix  B  (i.e., 

AB  #  0).  Although  we  now  require  AC  =  0,  (i.e..  Ci  = 

0,  i  =  1,  ...,  p)  to  obtain  closed- form  gain  expres¬ 
sions  for  (Ac,  Bc,  Cc).  We  begin  with  the  following 
lemma: 

Lemma  6.1.  Suppose  the  system  (2.8)  is  asymptoti¬ 
cally  stable  for  all  (AA.  AB,  AC)  e  U  for  a  given  (Ac. 
Bc ,  Cc ) •  Then 

J(AC,  Bc,  Cc)  =  sup  tr  P^V ,  (6.1) 

(AA.  AB,  AC)eU 


a 


(6.2) 


where  t  W"  is  the  unique  solution  to 

0  =  (A  +  AA)tPaj  ♦  ^(A  +  AA)  +  R. 

Proof .  See  [3] .  □ 

Utilizing  (6.1)  in  place  of  (2.10),  the  Hoc  distur¬ 
bance  attenuation  constraint  from  plant  and  sensor  dis¬ 
turbances  to  the  «tat.e  and  control  variables  given  by 

I|HaA(s)||»  =  ||E[sI„-  -  (A  t  AA)] ' 1  Dao||®  <  7  (6.3) 

can  now  be  enforced  by  replacing  (2.14)  by  the  modified 
Riccati  equation 

0  =  ATP  +  PA  +  r2PVooP  +  fi(Cc,  P)  +  R, 

(AA,  AB,  AC)eU,  (6.4) 

where 

AATP  +  PA.4  <  ft(Cc,  P),  (AA,  AB,  AC)eU.  (6.5) 

Note  that  (6.4)  is  merely  the  dual  of  (2.14).  Vie  also 
require  the  condition  dual  to  (2.15)  given  oy 

( [R  t  r2PVcoP  +  fl(Cc,  P)  -  (AATP  +  PAA)]*,  A  +  AA) 
is  detectable  for  all  (AA,  AB)eU.  (6.6) 

For  the  structure  of  U  as  specified  by  (4.1)  with 

AC  =  0,  the  bound  ft  satisfying  (6.5)  can  now  be  given  a 
concrete  form. 

Proposition  6.1.  Let  a  be  an  arbitrary  positive 
scalar.  Then  the  function 


0  =  (A0  +  r2v1(0[p  ♦?])(!♦  Q(Aa  ♦  rJvtJP  ♦  p])t 
t  V,  ♦  .!  ^[AjQA[  +  (A,  -B.RjJPJQtA,  -B.RjiP,)"] 

-  sqsqsx  +  r  SqEqsV,  (6.10) 


0  =  (Aft  -SQE  +  r2VlooP)TP  t  P(Aa  - SQS  ♦  * 

r2 P(V)oo  ♦  /f-SQSqsT)P  +  p;^.ps  -^p;Bjip,rAf  (6.11) 


0=  (Aa-BRi*Ps  +  7‘ 2VlooP)Q  ♦  Q(Aa-BRj>Ps 
+  SQ£QSt  -rjSQSqsV, 

+  7'  2Vi3)P)t 
(6.12) 

and  let  (Ac,  Bc,  Cc,  P)  be  given  by 

Ac  =  T(A  -SQE  -BR^*PS  ♦  r2Vl(P)GT, 

(6.13) 

bc  =  rsqcTVji , 

(6.14) 

Cc  =  -R^JPSGT, 

(6.15) 

p  =  P  +  P  -  pgt 
-CP  GPGt 

(6.16) 

Then,  (E,  A  +  AA)  is  detectable  if  and  only  if  A  +  AA 
is  asymptotically  stable  for  all  (AA.  AB)  e  U.  In  this 

case,  the  closed- loop  transfer  function  H^(s)  satis¬ 
fies  the  Hoo  disturbance  attenuation  constraint, 

l|liAA(s)||«  <  7.  (AA,  AB)eU,  (6.17) 


ft(Cc.  P)  4  nP  +  a'  E  o?A[PA[ 

i  *  1 


and  the  worst  case  I2  performance  criterion  (6.1) 
satisfies  the  bound 


satisfies  (6.5)  with  U  given  by  (4.1)  and  AC  =  0.  with 

0  defined  by  (6.i).  the  modified  dual  Riccati  equation 
(6.4)  becomes 


0  =  AaP  +  PAa  +  7* 2 PVoeP  ♦  £  AjA^PS,  +  R.  (6.3) 

Ve  can  now  state  sufficient  conditions  for  robust 
stability,  robust  L2  performance,  and  robust  distur¬ 
bance  attenuation  for  the  dual  problem.  For  arbitrary 

Q,  P,  P  (  Rn!<n  and  0  >  0  define  the  following  notation: 

R3s  =  h  *  £  <5iB[(P  +  P)Bj ,  PS=BTP  +  £  AiB[(P  +  P) Aj , 
i  *  1  i s  I 

S  =  (I„  +  7' 2 z?2 QP ) ' 1 ,  E  4  CTVj'C. 


Theorem  6.1.  Suppose  there  exist  P,  Q,  P,  Q  e  INn 
satisfying  (5.10)  and 

0  =  A^p  +  PAa  *  7' 2 PVj ^P  +  R,  *  |£  «,A7(P  ♦  P) Aj 
-PjRiiPs  +  (6-9) 


(Ac,  Bc.  Cc)  <  tr[(P  +  P)V,  +  PSQEQStP]  .  (6.18) 

Remark  6. 1 .  The  dual  case  of  Remark  5.6  is  obtained  by 
setting  AA  =  0,  AB  =  <riBi ,  AC  =  0,  and  B(  =  B.  The  re¬ 
sulting  L2/1I*  design  possesses  guaranteed  gain  margin 
of  ±100?! percent  at  the  input. 


VII.  Uncertainty  Structure  and  Sufficient  Conditions 
for  Robust  Stability  and  Performance  with  Hx 
Disturbance  Attenuation:  Quadratic  Bound 

Ve  now  assign  a  different  structure  to  the  uncer¬ 
tainty  set  U  and  the  bounding  function  ft.  Specifi¬ 
cally,  the  uncertainty  set  U  is  assumed  to  be  of  the 
form 


U  =  {(AA,  AB,  AC):  AA  =  £  F s M 4 N s G s  , 

i  s  l 

AB  =  E  FjMjN'jH, ,  AC  =  r  KjMjNjG, , 

i  =  1  i  •  I 

MjM[  <  fij,  N[.Nj  <  N,.  i  =  1,  ....  p},  (7.1) 

where,  for  i  =  1 . p:  Fs  c  Rn*ri,  Gj  e  R1'*", 

Hi  c  Rl ' *m ,  and  Ks  c  R/xri  are  fixed  matrices  denoting 
the  structure  of  the  uncertainty:  Hj  e  INr >  and  Nj  e  IN1  ’• 


are  given  uncertainty  bounds;  and  Mj  e  IRr > xs  >  and 
Ni  <  are  uncertain  matrices. 

In  order  to  obtain  explicit  gain  expressions  (Ac, 
Bc,  Cc)  we  again  consider  two  cases,  1)(AA,  AC)  e  U 
with  AB  =  0  and  2)(AA,  AB)  e  U  with  AC  =  0.  Vnen 
AB  =  0  the  closed- loop  system  has  structured  uncer¬ 
tainty  of  the  form 


and  let  Q  be  given  by  (5.14)  and  (Ac,  Bc,  Cc)  by 

Ac  =  r(A  -eps  -qav^c  ♦  q[r2Rloo  ♦  E])GT,  (7.9) 
Bc=rqaVji,  (7.io) 

Cc  =  -  »  BtPSGt.  (7.11) 


AA  =  I  FjMjNjG; ,  (7.2) 

i  *  i 

where , 


LBcKi 

In  this  case  the  quadratic  bound  Q  satisfying  (2.13) 
can  now  be  given  a  concrete  form. 

Proposition  7.1.  The  function 


Then,  (A  +  AA.  D1  is  stabilizable  if  and  only  if  A  +  AA 
is  asymptotically  stable  for  all  (AA,  AC)  e  U.  In  this 
case,'the  closed- loop  transfer  function  H,j(s)  satis¬ 
fies  the  H®  disturbance  attenuation  constraint 

l|HAi(s)||»  <  7,  (AA,  AC)  e  U,  (7.12) 

and  the  worst  case  L2  performance  criterion  (2.10)  sat¬ 
isfies  the  bound 

J(AC,  Bc,  Cc)  <  tr[(Q  +  Q)R,  +  QSTPEPSQ] .  (7.13) 


fl(Bc,  Q)  =  !  *  QG[NiG,Q  (7.3) 

i  s  1 

satifies  (2.13)  with  U  given  by  (7.1)  and  AB  =  0. 

Proof .  See  [3] .  □ 

Thus,  with  11  defined  by  (7.3),  the  modified 
Riccati  equation  (7.3)  becomes 

0  =  Aq  +  qAT  +  7'2QM  +  v 

+  f  [FiSiiFlT  +  (7.4) 

i 8 1 

For  arbitrary  Q  e  IRnxn  define: 


Proof.  The  proof  follows  by  combining  the  proofs 
of  Theorems  6.1  of  [l]  and  Theorem  8.1  of  [3].  0 

Remark  7.2.  It  is  interesting  to  note  that  the 
full- order  case  nc  =  n  with  G  =  T  =  r  =  I„  and  t  -  0 

(see  Remark  5.1),  P  plays  no  role  so  that  (7.8)  is 
superfluous.  Tnus,  unlike  the  full- order  result  for 
the  linear  bound  involving  four  equations,  the  full- 
order  quadratic  bound  involves  three  modified  Riccati 
equations  coupled  by  the  uncertainty  term  and  the  H® 
constraint.  If,  alternatively,  the  reduced- order  con¬ 
straint  is  retained,  but  the  uncertainty  terms  are  de¬ 
leted,  then  the  results  of  [l]  are  recovered.  If, 
furthermore,  the  uncertainty  terms  are  retained,  but 
the  II®  constraint  is  sufficiently  relaxed,  i.e., 

7  —  ®,  the  results  of  [3]  are  recovered. 


qa  4  qcT  +  e  Fj  fljKj . 

D4jFiM.Fl, 

VIII.  The  Dual  Case:  Ouadratic  Bound 

i  *  1 

l  *  1 

For  the  structure  of  U  as  specified  bv  (7, 

.1)  with 

V2a  4  V2  +  £  Kj  Mj  K[, 

»  *  1 

E  4  E  G^NjGj  . 

i =  1 

AC  =  0,  the  closed- loop  system  has  structured  uncer¬ 
tainty  of  the  form 

Theorem  7.1.  Suddo se 

these  exist  Q,  P,  q,  P  e  Mn 

AA  =  £  FjMjNjG;  . 

(8.1) 

satisfying  (5.10)  and 

i  *  1 

o  =  Aq  +  qAT  +  7'2qRi00Q  +  v 

’[  +  QEQ  +  D 

where 

-WX  +  ^PaVj>qI^, 

(7.5) 

f4  [  ],  «,  4  [Gi  H,Cc] . 

0  =  (A  ♦  [Q  +  Q]  [r  2R!(J)  ♦  E])TP 

♦  P(A  ♦  [Q  ♦  Q][r2Rlao  ♦  E]) 

+  R,  -STPEPS  +  rVPEPSr^,  (7.6) 

0  =  (A  -EPS  +  q[7-2R|a  +  E])Q  +  0(A  -EPS 

♦  Q[r2*i„  ♦  E])T  *  0(7  2  [Rtao  *  d2STP£PS]  ♦  E)jj 

♦  WX  -r^aVilq:^,  (7.7) 

0  =  (A  -QaVj'C  ♦  Q[7-2R1oo  ♦  E])Tp  +  P(A  -qaVj*C 
+  Q[7'2Rtoo  +  E] )  +  StPEPS  -  r^STPEPSr^, 


Proposition  8.1.  The  function 

Q(Cc,  P)  =  E  GTNjCj  +  PFj Fj P  (8.2' 

i s  l 

satisfies  (6.5)  with  U  given  by  (7.1)  and  AC  =  0. 

With  fi  defined  by  (8.2),  the  modified  dual  equa¬ 
tion  (6.4)  becomes 

0  =  AtP  +  PA  +  7"  2PV®P  +  R 

+  £  [G[NjGi  +  PFjMjFjP] .  (8.3) 

I  s  1 


(7.8) 


For  arbitrary  P  e  R»*“  define: 


Pa  4  BtP  ♦  _!  Hjf^G,  -  Rja  -  R*  ♦  . 


satis 


Theorem  8.1.  Suppose 
isfying  (5.10)  and 


there  exists  P,  Q,  P,  Q  e 


0  =  AtP  +  PA  +r1 2PV,  P  +  R.  +  E  +  PDP 
1 00  * 

-P&iPa  +  (8.4) 

0  =  (A  ♦  [r*Vl<s  «■  D][P  +  P])Q  +  Q(A  +[r2vloo  *  D] 

[P  +  P])T  +  V,  -SQEQSt  +  r^SqgqsV,  (8.5) 

o  =  (a  - sqe  +  [r2vloo  +  d]P)tp  +  P(A  -sqs 

+  [r2vloo  +  D]p)  ♦  p(r2[vljB  ♦  psmsT]  ♦  djp 
♦  Pl^iPa  -'iP&iPaV  (8-6) 

0  =  (A  -BR*‘Pa  ♦  [r2Vloo  +  D] P)Q  ♦  QfA  -BR^iPa 

+  [r2Vi.  +  dip)  +  sqsqsT  -^sqsqsV,  (8.7) 

and  let  P  be  given  by  (6.16)  and  (Ac,  Bc ,  Cc )  by 

Ac  =  r(A  -sqs  -BR^iPa  +  [r2Vloo  ♦  D]P)Gt,  (8.8) 


bc  =  rsqcTVji , 


(8.9) 


cc  =  -^iPacT- 


(8.10) 


Then  (E,  A  +  AA)  is  detectable  if  and  only  if  A  +  AA  is 
asymptotically  stable  for  all  (AA,  AB)  e  U.  In  this 

case,  the  closed- loop  transfer  function  ii^(s)  satis¬ 
fies  the  H®  disturbance  attenuation  constraint 

II II aA ( s ) II30  <  7,  (AA,  AB)eU,  (8.11) 

and  the  worst  case  L 2  performance  criterion  (6.1) 
satisfies  the  bound 


3)  nonstrictly  proper  plant  model,  i.e.,  (2.2) 
replaced  by 

y(t)  =  (C  +  AC)x(t)  +  (D  +  AD)u(t)  +  Djw(t)  (2.2) 

4)  nonstrictly  proper  controller,  i.e.,  (2.4) 
replaced  by 

u  ( t )  =  CcXc(t)  +  Dcy(t)  (2.4) 

and  the  related  problems  of  singular  control 
weighting  (R2  >  0)  and  singular  measurement 
noise  (V2  >0) 

5)  discrete- time  and  sampled  data  design. 
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VIII.  Further  Extensions 

The  results  of  this  paper  can  be  readily  extended 
in  several  directions: 

1)  Mixed  bounds,  i.e.,  letting  AA  =  AAi  +  AA2  and 
bounding  AAi  with  the  linear  bound  and  AA2  with 
the  quadratic  bound  (this  would  unify  the  lin¬ 
ear  and  quadratic  bound  results) 

2)  L2  and  H®  cross  weighting  terms  (e.q.. 
xTR]2u)  as  well  as  correlated  plant  dis¬ 
turbance  and  sensor  noise 
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Optimal  Output  Feedback  for  Nonzero  Set  Point 
Regulation 

DENNIS  S.  BERNSTEIN  and  WASSIM  M.  HADDAD 

Abstract— Motivaiti  by  Ik  results  of  Artstein  and  Leizarowitz  (2)  on 
Steady-Male  periodic  tracking,  a  continuous-time  nonzero  set  point 
regulation  problem  is  considered  which  involves  1)  noisy  and  aounoisy 
measurements,  2)  weighted  and  unweighted  controls,  3)  correlated  plant/ 
measurement  noise  and  cross  weighting,  4)  nonzero-mean  disturbances, 
and  5)  state-,  control-,  and  measurement-dependent  white  noise.  It  is 
shown  that  in  the  absence  of  multiplicative  disturbances  the  closed-loop 
control  can  be  designed  independently  of  the  open-loop  control.  Unlike 
[21,  the  results  are  obtained  without  using  the  overtaking  criterion. 

I.  INTRODUCTION 

The  quadratic  performance  criterion 

Jk  t  '  xT(l)Qx(t)+uT(t)Ru(t)  dl  (1.1) 

•’ll 

expresses  the  desire  to  minimize  deviations  of  the  state  x(t)  of  the  system 

x(t)  =  Ax(t)  +  Bmt)  (1.2) 

from  the  regulation  point  x  =  0.  As  is  well  known  [1,  pp.  270-276).  the 
nonzero  set  point  criterion 

J  -  (  ‘  lx(i)-X]TQ\x(t)-*)  +  uTV)Ru(t)  dt  (1.3) 
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presents  no  additional  difficulty  as  long  as  x(t)  and  u(t)  are  replaced  by 
x(l)  -  J?  and  u{t)  -  i3,  where  U  satisfies 

0=AX  +  Bil.  (1.4) 

Closer  inspection,  however,  reveals  that  this  approach  is  suboptimal. 
Specifically,  the  offset  tf  in  the  control  may  correspond  to  an  unacceptably 
high  level  of  control  effort  when  i7  TRd  is  large.  Hence,  this  approach 
overlooks  design  tradeoffs  concerning  the  control  effort  required  for 
maintaining  the  nonzero  regulation  point  i.  Moreover,  such  an  approach 
is  impossible  when  0  satisfying  (1.4)  does  not  exist. 

A  significant  advance  in  extending  the  LQR  formulation  to  steady-state 
tracking  problems  (and,  hence,  to  nonzero  set  point  regulation)  was  given 
by  Artstein  and  Leizarowitz  in  |2).  They  consider  the  performance 
criterion 

Jmk  f"  lx«)-r(r)]TQ[xU)-rv)]  +  uT(t)RuV)dt  (1.5) 

Jo 

where  T(  • )  is  periodic  on  |0,  »)  and  the  minimization  of  J„  is  performed 
in  the  sense  of  the  overtaking  criterion.  For  the  nonzero  set  point  problem 
(T(r)  ■  j?)  with  full-state  feedback  plus  constant  offset  control  law 

u(/)  =  X>(/)  +  a  (1.6) 

it  follows  from  [2,  Theorem  2]  that  K  and  a  are  given  by 

K=-R'BTP,  (1.7) 

a»  -R-'Br(A-lP)  rQX  (1.8) 

where  P  satisfies  the  Riccati  equation 

0  =  AtP  +  PA+Q-PXP  (1.9) 

with!  tt  BR  'Bt. 

Two  features  of  the  control  law  (1.6)-(1.8)  are  noteworthy.  First,  (1.6) 
consists  of  both  a  closed-loop  feedback  component  Kx(!)  and  an  open- 
loop  component  a  depending  upon  the  regulation  point  (Fig.  1).  Second 
(and  more  important),  is  the  observation  that  the  closed-loop  control 
component  is  independent  of  the  open-loop  component.  From  a  practical 
point  of  view  this  feature  is  quite  useful  since  it  implies  that  the  feedback 
gain  K can  be  determined  without  regard  to  the  set  point.  Hence,  a  change 
in  the  desired  set  point  j?  during  on-line  operation  does  not  necessitate 
resolving  the  Riccati  equation  in  real  time;  only  a  requires  updating.  For  a 
new  value  of  j?,  a  can  readily  be  recomputed  on-line  via  the  matrix 
multiplication  operation  (1.8). 

The  contribution  of  the  present  note  is  an  extension  of  the  result  of  (21 
as  applied  to  the  nonzero  set  point  regulation  problem  without  using  the 
overtaking  criterion.  We  extend  this  result  in  the  following  different 
ways. 

1)  Output  Feedback  with  Noisy  and  Nonnoisy  Measurements:  To 
obtain  a  more  realistic  problem  setting,  we  consider  the  case  in  which  the 
full  state  is  not  available,  but  rather  only  measured  linear  combinations  of 
states  Moreover,  we  consider  the  possibility  that  some  of  the  measure¬ 
ments  are  corrupted  by  white  noise  while  others  are  noise  free.  Note  that 
the  noise-free  case  was  considered  in  (31  while  the  fully  noisy  case  is  the 
standard  assumption  in  LQG  theory  As  in  (4]-(6]  we  express  the  solution 
in  terms  of  a  projection  corresponding  to  the  noise-free  measurements. 

2)  Singular  Control  Weighting:  As  noted  in  (6),  (7]  static  continu¬ 
ous-time  feedback  of  noise-corrupted  measurements  results  in  unbounded 
coat  unless  the  corresponding  controls  are  unweighted.  Hence,  we  allow 
for  both  weighted  and  unweighted  controls  to  which  the  noise-free  and 
noisy  measurements  are  fed,  respectively.  This  setting  leads  to  an 
additional  projection  dual  to  the  projection  arising  from  the  noise-free 
measurements  {61- 

3)  Correlated  Plant  and  Measurement  Noise  and  Cross  Weight¬ 
ing:  To  allow  greater  design  flexibility  we  allow  the  possibility  that  the 
plant  and  measurement  noise  are  correlated.  In  addition,  we  consider  the 
dual  design  feature,  namely,  cross  weighting  in  the  performance  criterion. 

4)  Nonzero-Mean  Disturbances:  In  addition  to  the  presence  of  zero- 


mean  white  plant  disturbances  we  allow  for  the  possibility  of  a  nonzero 
constant  disturbance  offset.  In  contrast  to  (1,  pp.  277-281],  our  result 
shows  that  the  presence  of  a  constant  disturbance  offset  leads  to  an 
additional  offset  in  the  open-loop  component  of  the  control. 

5)  Multiplicative  While  Noise:  In  addition  to  the  above  generaliza¬ 
tions  we  allow  for  the  presence  of  multiplicative  disturbances  in  the  plant. 
The  control  law  thus  generalizes  previous  results  involving  state-,  control- 
and  measurement -dependent  noise  [8|-|ll],  As  shown  in  [12)-[14],  the 
multiplicative  white  noise  model  can  be  used  to  guarantee  robustness  with 
respect  to  deterministic  plant  parameter  variations. 

n.  Notation  and  Definitions 


a.  *rx»,  S' 

real  numbers,  r  x  s  real  matrices,  JTX 1 

i 

expectation 

/,.  (  V 

r  x  r  identity,  transpose 

®,  ® 

Kronecker  sum.  Kronecker  product 

asymptotically 

matrix  with  eigenvalues  in  open  left- 

stable  matrix 

half  plane 

n,  m,,  m2,  l„  l2,  p,  r 

positive  integers 

x-  u,.  i/2.  y„  yi 

n,  #»,,  m2,  /,,  l2  -dimensional  vectors 

A,  A,\  B) ,  Bui  Ct,  Cu 

n  x  n  matrices;  n  x  m,  matrices;  /,  x 
n  matrices,  /  =  I,  •  •  •,  p 

B2,  Ci,  fC],  Ki,  L 

n  x  m2,  l2  x  n,m,  x  l2,  m2  x  l,,r  X 
n  matrices 

on.  012,  7,  6 

m,,  m2,  n,  r-dimensional  vectors 

*».(/> 

unit  variance  white  noise,  i  =  1,  •  ■  • ,  p 

W0(0,  w,(r) 

n  -dimensional,  l,  -dimensional  white 
noise 

yB,  y, 

intensities  of  w0,  w,;  V0  2:  0,  V,  >  0 

y*> 

n  x  /,  cross  intensity  of  w0,  w. 

Ro •  P\ 

r  x  r  and  m,  x  m,  state  and  control 
weightings;  R0  £  0,  /?,  >  0 

Rot 

r  x  m,  cross  weighting; 

R0  -  R0,R;'RT0I  ±  o 

A,  A, 

A  +  B^K\C2  +  S;A':C|,  A,  +  B\,K\C2 
+  B2K2Cu.  i  =  1,  '•  •.  p 

B,S. 

B,cti  -f  B2a 2  +  7,  *„(»„  i  =  1,  •  •  • , p 

wit) 

w0(I)  +  B2K2w,(t) 

V 

Vo  +  K01A'[fl[  +  B2K2VTm  + 

B2K2y,KfB! 

B 

LTR0L  +  LTRMKtC2  + 

C\K  [R  0r,  L+C[/tr[RtR,  C: 

For  arbitrary  n  x  n  Q,  P  such  that  the  indicated  inverses  exist,  define, 
r,  4  QC[(C3gC[)  'C2,  Tj  A  B2(B^PB2) 'B\P. 

T|  i  A  /.  —  f|,  r2  J.  6  /„  -  Tj, 

Vu  A  V,  +  £  CtQ+rfl.rfiJICl,  R„  A  R,  +  £  BTUPBU, 

»-i  f-i 

6  QCJ+  F0I  +  £  A,(Q+ttl,'f>,r)C[t. 

1*1 

<J>,  A  BJPyRlLyj^BlPA,, 
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A,  A  fit,  k-A;'B, 

A,.  A  Al-B,./t-‘<P,Tl-T2eilt'-,,Cu. 

A.,  A  <F,T,xA;'+BjA;rP,  &u  A  B\(PA;'+A;tP), 
Ou  A  A| ,fij.  Oil  A  A iflB2t 

A,  A  A;^Ra-r]9TR^Rr)t 
An  A  An  A  B\ A,, 

Q,  A  OCf+Kol,  <S>  A  BJP+Rr. 

A  &  A-BlR;'<?ri-T1Q.V;'Cl,  rftb-A-'B, 

*  A  /?,-«rrli^-,al+fi1M-7'Tfi(Pr), 

A,  A  +  Aj  A 


To  analyze  (3.7)  define  the  second-moment  and  covariance  matrices 

QV)  A  KMOjr’m  Q(t)  A  <3(0- m(r)mT(r) 

where  m(i)  A  B[x(r)].  It  follows  from  (15,  p.  142],  that  <3 (0,  Q(0,  and 
m(l)  satisfy 

<3(0«/f<3(/)+3(0^r+  P+BmTV)  +  m(t)Br 

+  2  [A&OAr+A.minST+S.m^oAT+B.B?],  (3.8) 

/- 1 

G(0  =  -*Q(0  +  Q(0^r+P+2  lA.QinA^+A.minm^nAj- 

I-  1 

+/fim(r)fi,7'+fi,.„7'(r)/f,7'+A^lrl,  (3.9) 
m(t)  =  Am(t)  +  B.  (3.10) 

To  consider  the  steady  state,  we  restrict  our  consideration  to  the  set  of 
second-moment  stabilizing  gains 


0,  A  A|fi],  Q,  A  A:Bj, 
A  A  y4-r(ir/?<)-r1(S‘rB-1BJ|), 


P 

8,  A  {(AT, ,  X2):  A  (B  A  +  ^  A,  ®  A,  is  asymptotically  stable). 


A,  A  BfA-Bj.  A2  A  Bjf A, 

A0  =  A-fl,B,-‘(Pr,.  ♦„  A  B,-((Prlii40-,fl,  +  BfA-7’Tli<PJ-). 

A,o  A<Pru,40-'  +  B[ri-rP, 

A,o  A  B]A-TaTRo-tl(9TR;'Rl)-R l , 
DA  BtR;'Bj,  A,  b  A-XP. 

ni.  Nonzero  Set  Point  Regulation 
Nonzero  Set  Point  Problem:  Given  the  controlled  system 


XV) 


=  (^  +  E  MIM.J  Jf(0 

+  ^S,  +  |)  v,(f)B„^  u, 


(O  +  BjUjfO-t-wodl  +  y  (3.1) 


with  measurements 


y,(f)=^C,  +  2j  Jt(r)+w,(r), 


(3.2) 


y2V)=C2x(r)  (3.3) 

where  /  €  (0,  oo),  determine  A,.  Af:,  a,,  and  a2  such  that  the  static  output 
feedback  law 

UiV)*Xiy2(0  +  a,,  (3.4) 

u2V)-K2y,V)  +  a2  (3.5) 

minimizes  the  performance  criterion 
/(#f,,  K2,  a,,  aj)-lim  «(Ujr(f)-5)r R,(/jr(t)-«) 

t—m 

+  2(8jr(i)-*)rR„»1(0+«r(')/fiV.(OI.  (3.6) 
The  closed-loop  system  (3. 1)— (3.5)  can  be  written  as 

*V)~[A+'£vlV)Al)xV)  +  B+'£«lV)B+*(t)-  (3.7) 

\  /-i  /  /-i 


It  follows  from  fundamental  properties  of  Lyapunov  equations  that  if  (Afa, 
K2 )  £  Sj,  then/f  is  also  asymptotically  stable.  Hence,  for  (A',,  K2)  6  S„ 
Q  A  lim,-.  (3(J),  Q  A  lim,-.  Q(t)  and  m  A  lim,-.  m(t)  exist  and 
satisfy 


0~AQ+QAT+Bm  +  m8T+  P+2  {A.QAJ 

im  | 

+  A,mB*  +  B,mTA*+ B,BJ],  (3.1!) 
0 =AQ+QA+P+^^  [A,QAj+AimmTA* 

+A,mBj+B,mTAjji-B,Bl],  (3.12) 
0  =  Am  +  B.  (3.13) 

Now  J(K |,  K2,  O),  ar2)  is  given  by 

J(K i.  A2,  Oi,  a-)  =  tr  KQ  +  mm  T)B)  -  2m  TL  TR„i 
+  6TR06  +  2mTL  TR0ia, 

—  2  6  rR(n  K\  C2m  —  25  r  Rqi  a  t 
+  2mTCjKJR,a)  +a*R,a,.  (3.14) 

Associated  with  Q  is  its  dual  P  z  0  which  is  the  unique  solution  of 

P 

0  =  ATP+PA  +  8+'%l  AJPA,.  (3.15) 

I-  1 

To  obtain  closed-form  expressions  for  the  feedback  gains  we  further 
restrict  consideration  to  the  set 


t;  A  \(K„  K2)  €  8,:  C2QC\ ,  BJPBi,  *, 

and  Q[j*"l01,+  0J,  are  invertible). 


and  assume 


[B„#0  -  C„-0],  fl,  (3.16) 

Optimizing  (3.14)  subject  to  (3.12)  and  (3.13)  yields  the  following  result 
illustrated  in  Fig.  2. 

Theorem  3.1:  Suppose  Kt,  Kt,  <*i,  o2  solve  the  nonzero  set  point 
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problem  with  (tf,,  K2)  €  S  *  Then  there  exist  rt  x  n  Q>  P  &  0  such  that 
K\  =  -R'^OCUCiOCl)-'.  (317) 

KI=-(BlPB2Y'BTlPd,V-is\  (3.18) 

+  (319) 

a1=(Q'-.*;,Q„+QiJ)-|[(0r,*;'A'*+Al,)7-(QrA-,A„+AJ1)8]. 

(3.20) 

and  such  that  Q  and  P  satisfy 

0  =  (A  ~B,R  ;,'<?.t,)Q  +  Q{A -B,A  ,">.t,)t+  V0 

+  £  KA.-B^R  r>.T x)Q(A,-BuK  ,'>.».)  r 

1m  ( 

+  4,,/ft,  Ar]Aj,+ A„rfi,Bj  +  B,rfiTiAjl  +  B,B ,r) 

-4,K,V+’i**'r»VrL>  <3-21> 

0=  (-4  -  r2<a.,  ^ -'c, )  rP+  P(A  -  nd,  K  ■ ‘c, )  +  A„ 

+  £  (<4, -  rjQ,  K  -JCuVPIA, -TjQ.,  K -'c1() 

1-1 

-Vjx  u*.+  tU  <9  JR  ,  .  (3.22) 

Outline  of  Proof:  As  in  (16)  the  result  is  obtained  by  forming  the 
Lagrangian  while  accounting  for  (3.12)  and  (3.13).  Define 

£(A|,  A2,  or i .  ot.,  Qt  m)  =  tr  [X,7(ff|,  A2,  ot|,  a2) 

+  P  (RHS  of  (3 . 1 2)]  +  X  T(Am  +  fi)J 

where  Xo  «t  0  and  X  €  33".  Setting  dJ Z/dQ  =  0  and  using  the  second- 
moment  stability  assumption  it  follows  that  Xo  =  1  without  loss  of 
generality.  The  derivation  now  follows  by  setting  the  partial  derivatives  of 
£,  with  respect  to  K>,  A2,  a,,  a2,  and  m  to  zero  and  solving  for  the  gains. 
To  assist  the  reader  in  carrying  out  the  details  we  note  that  X  is  given  by 


X -  - 2A-  M  -  PB- £  AJPB,  +  L  TRo 


-Lr/fo,a,  +  C2rX,*£«-CJrKf*,  o,).  □ 

Remark  3. 1:  Because  of  the  presence  of  6  in  (3.21)  via  a,  and  a2  in  B 
(see  the  definition  of  At,)  and  a,  in  Bt,  the  closed-loop  component  of  the 
control  law  (3.17)-(3.20)  cannot  be  designed  independently  of  the  open- 
loop  component.  As  now  shown,  independence  is  recovered  when  the 
multiplicative  noise  terms  are  absent. 


IV.  Specializations  of  Theorem  3.1 

To  draw  connections  with  the  previous  literature,  a  series  of  specializa¬ 
tions  of  Theorem  3.1  is  now  given.  We  begin  by  deleting  all  multiplicative 
white  noise  terms,  i.e., 

Aj,  Bllf  C|i=0,  i  =  l,  •••,/>.  (4.1) 

In  this  case  the  stabilizing  set  S,  can  be  characterized  by 
$  =  {(A,,  A2):  A  is  asymptotically  stable}, 
and,  furthermore,  S 'becomes 

8*  6  {(A,,  A2)  €  8:  C:QCT},  BT;PB2, 

♦  and  0  +  02  are  invertible}. 

Corollary  4.1:  Assume  (4.1)  is  satisfied  and  suppose  fCt,  A2,  on,  a2 
solve  the  nonzero  set  point  problem  with  (A| ,  K2)  6  8*.  Then  there  exist 
n  x  n  Q,  P  2:  0  such  that 

A1=-/^|-1(PeCJ(C2QC2r)-,,  (4.2) 

K2=-(BlPB2r'BlPQ.Vt\  (4.3) 

on  =  *''(0|ft2  + Ai7-A,6),  (4.4) 

ft2  =  (nj"*-1C1-t-Q2)-,((0[+''A1  +  A2)y-(Of*-|A1  +  A2)8],  (4.5) 

and  such  that  Q  and  P  satisfy 

0 = (A  -  B,  R  ; 1  <S>  r,  )Q  +  Q(A  -  B,R  - '  <P  t,  ) r  +  VB 

-Q.V;'Q.t+t22Q.V;'Q.tt^,  (4.6) 

o<*(A-T2Q.Vi‘c,)TP+P(A-T2eiy~'Ct)+Ro 

-<?’7?-,<P  +  Tj'i<J>77f-,<PTli.  (4.7) 

In  addition  to  (4. 1)  we  assume  further  that  all  controls  are  weighted  and 
all  measurements  are  noise  free,  i.e., 

B.  =  0,  C,=0.  (4.8) 

This  corresponds  to  the  setting  considered  in  (3) .  It  follows  from  the  proof 
of  Theorem  3. 1  that  the  assumption  B:  =  0  leads  to  t2  =  0,  and  C,  =  0 
corresponds  to  deleting  (3.5).  Hence  S  and  S  *  are  now  given  by 

S0  =  {A, :  A  +  B,KtC2  is  asymptotically  stable}, 

80*  a  {A,  6  So-'  C2 QC l  and  4>0  are  invertible}. 

Corollary  4.2:  Assume  (4.1)  and  (4.8)  are  satisfied  and  suppose  Ai 
and  a,  solve  the  nonzero  set  point  problem  with  A,  6  S0*.  Then  there  exist 
n  x  n  Q,  P  z  0  such  that 

A,=  -B-'(PQC2r(C2(?C[)-'.  (4.9) 

<x.  =  *o'(A,o7-A)0$).  (4.10) 

and  such  that  Q  and  P  satisfy 

0  =  (A-BiR;'&t,)Q+Q(A-BiR;'6>t,)t+  K0,  (4.11) 

0  =  ArP+PA+R()-<yTR;l<9  +  T*1<S>TR;'<PT,x.  (4.12) 

We  now  specialize  further  to  the  full-state  feedback  case,  i.e.. 


and  hence  rt  =  /,  and  rlx  =0.  Now  So  and  S0*  become 
$i  A  {A,:  A  +  fl, A,  is  asymptotically  stable}, 
8*  A  (A,  6  6,:  Q  is  invertible} . 
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Corollary  4.3:  Assume  (4.1),  (4.8),  and  (4.13)  are  satisfied  and 
suppose  K,  and  a,  solve  the  nonzero  set  point  problem  with  Kt  €  8  * . 
Then  there  exist  n  x  n  Q,  P  t  0  such  that 

(4.14) 

o.,  -  R  ;• '  B  TA  f TPy  -  R  ; '  (fl \A  *R0 - <J>  *R  fi i*  r  ) _  K  r  Ja 

(4.15) 

and  such  that  Q  and  P  satisfy 

0  =  M-fl,R-|(P)Q  +  g(A-fl,AJ-'(P),‘+Kl),  (4.16) 

0  =  AtP  +  PA+R0-<PtP,<P-  (4.17) 


Analysis  of  Time- Varying  Scaled  Systems  Via  General 
Orthogonal  Polynomials 

TSU  TIAN  LEE  and  YIH  FONG  CHANG 

Abstract — General  orthogonal  polynomials  are  introduced  to  analyze 
and  approximate  the  solution  of  a  dais  of  sealed  systems.  Using  the 
operational  matrix  of  integration,  together  with  the  operational  matrix  of 
linear  transformation,  the  dynamical  equation  of  a  scaled  system  is 
reduced  to  a  set  of  simultaneous  linear  algebraic  equations.  The 
coefficient  vectors  of  the  general  orthogonal  polynomials  can  be  deter¬ 
mined  recursively  by  the  derived  algorithm.  An  illustrative  example  is 
given  to  demonstrate  the  validity  and  applicability  of  the  orthogonal 
polynomial  approximations. 


Finally,  setting 

>  *0,  *0I=0,  L  =  l,  (4.18) 

we  obtain  the  result  of  (2). 

Corollary  4.4:  Assume  (4.1),  (4.8),  (4.13).  and  (4.18)  are  satisfied 
and  suppose  K,  and  a,  solve  the  nonzero  set  point  problem  with  K\  6  8  * 
Then  there  exists  n  x  n  P  &  0  such  that 

K,=  -R;'B]P,  (4.19) 

<*,»  -R-'BTxAi,TR0b  (4.20) 

and  such  that  P  satisfies 

0=ATP+PA±R0-P?.P.  (4.21) 
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I.  INTRODUCTION 

An  investigation  of  the  dynamics  of  an  overhead  current  collection 
mechanism  for  an  electric  locomotive  by  Ockendon  and  Taylor  (12J 
revealed  that  under  certain  conditions,  the  dynamics  of  the  systems  is 
characterized  by  a  differential  equation  containing  terms  with  a  scaled 
argument  of  the  form 

X(t)=AX(\t)  +  BX(t) 

X{0)-Xa 

where  X(Xt)  and  X(t)  are  n-vectors  and  A  and  Bare  n  x  rt  matrices  and 
the  constant  0  <  X  <  1 .  This  type  of  differential  equation  also  plays  an 
important  role  in  several  chemical  processes  [3],  [13].  This  equation  was 
first  studied  by  Fox  el  at.  [1 1]  with  the  introduction  of  a  finite  difference 
method  for  0  <  X  <  1 .  Recently,  the  solution  of  such  a  scaled  system  has 
been  obtained  by  several  different  orthogonal  functions,  such  as  Mock- 
pulse  functions  [14],  [21,  [3],  Walsh  functions  [1],  delayed  unit  step 
functions  [4],  Laguerre  polynomials  [5],  Chebyshev  polynomials  [6],  [7], 
and  Legender  polynomials  [15].  The  common  approach  of  these  methods 
is  the  use  of  the  operational  matrix  of  integration  together  with  the 
operational  matrix  of  scaling  to  reduce  the  differential  equation  to  a  set  of 
linear  algebraic  equations,  which  is  more  suitable  for  computer  program¬ 
ming. 

In  this  note  we  will  employ  the  operational  matrix  of  integration  and 
produci  operational  matrix  of  the  general  orthogonal  polynomials, 
together  with  the  operational  matrix  of  linear  transformation,  which  wifi 
be  derived  later,  to  obtain  the  solution  of  the  scaled  system.  The 
operational  matrix  of  linear  transformation  is  derived  based  on  the 
following  properties,  namely,  the  pure  recurrence  relation 

*„,(z)  =  (c,z  +  h,)*,(z)-c,*,_,U)  (I) 

with 

tfnfz)=  1;  tfi(z)  =  <w  +  6o 

and  the  differential  recurrence  relation 

1 6,(z)  =  A^„,(z)  +  fl,<6,(z)+C,<6,.,(z)  (2) 

where  recurrence  coefficients  a„  b„  c,  and  differential  recurrence 
coefficients  A„  B„  and  C„  are  specified  by  the  particular  orthogonal 
polynomials  under  consideration  and  some  are  listed  in  [9].  The  aim  of 
this  paper  is  twofold:  1)  to  derive  an  operational  matrix  of  linear 
transformation  for  general  orthogonal  polynomials  so  that  the  scaled 
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Optimal  output  feedback  for  non-zero  set  point  regulation: 
the  discrete-time  case 

WASSIM  M.  HADDADt  and  DENNIS  S.  BERNSTEIN* 

Optimal  discrete-time  static  output  feedback  is  considered  for  a  non-zero  set 
point  problem  with  non-zero  mean  disturbances.  The  optimal  control  law  consists 
of  a  closed-loop  component  for  feeding  back  the  measurements  and  a  constant 
open-loop  component  which  accounts  for  the  non-zero  set  point  and  non-zero 
disturbance  mean.  An  additional  feature  is  the  presence  of  state-,  control-  and 
measurement-dependent  white  noise.  It  is  shown  that  in  the  absence  of  multipli¬ 
cative  disturbances,  the  closed-loop  controller  can  be  designed  independently  of  the 
open-loop  control. 


Notation  and  definitions 

R,  R'*1,  Rr,  E  real  numbers,  r  x  s  real  matrices,  Rr“ ',  expectation 
/„,  (  )T  n  x  n  identity,  transpose 
®  Kronecker  product 
tr  Z  trace  of  square  matrix  Z 

asymptotically 

stable  matrix  matrix  with  eigenvalues  in  the  open  unit  disk 
n,  m,  /,  p  positive  integers 

x  n-dimensional  vector 
m,  y  m-,  /-dimensional  vectors 

A ,  Ap,  B,  Bp,  C,  C,  n  x  n  matrices,  n  x  m  matrices,  /  x  n  matrices,  t  =  1, ...,  p 
L,  K  r  x  n  matrix,  m  x  /  matrix 
<5,  y,  a  r-,  n-,  m-dimensional  vectors 
k  discrete-time  index  1, 2, ... 

Vi(k)  unit  variance  white  noise,  i  =  1, ...,  p 
wt(/c),  w2(k)  n-dimensional,  /-dimensional  white  noise  processes 

k', ,  V2  n  x  n  covariance  of  w, ,  /  x  /  covariance  of  w2;  K,  ^  0,  V2  ^  0 
Vl2  n  x  /  cross-covariance  of  w,,  w2 
R2,  R2  r  x  r  and  m  x  m  state  and  control  weightings;  R,  >  0,  R2  >  0 
R12  r  x  m  cross  weighting;  Rj  -  Rl2R2  1  R]2  ^  0 
A,  Aj  A  +  BKC,  A  $  +  B[KC  +  BKCj,  i  =  1, ...,  p 
A  ln- A 
B  Bx  +  y 
Bi  BjCc 

w  =  w,  +  BKw2  +  B,Kw2 

i  =  i 
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V  Vt  +  Vl2KTBT+BKVlT2  +  BKV2KrBT+  £  BiKV2KT Bj 

'  i=  1 

R  Lt  RxL  +  Lt  Rl2KC  +  CT  KT  R]2L+  C1  Kr  R2KC 

+  £  C]KtR2KC , 

1=  1 

For  arbitrary  me  R"  and  Q,  P  e  R"  * "  define: 


R23±R2  +  BTPB+  £  Bj  PBh 

i=  1 

R2a±R2  +  BTPB, 

Ps±BrPA  +  R}2+  £  BjPA„ 
1*1 

Pa  4  +  /?12, 

^^2  +  i  BjPAi, 

i  =  I 


F2i  4  k2  +  CQCt  +  £  C,(Q  +  mmT )Cj 

i  =  1 


F2a  4  K2  +  CQCT 

&4^0CT+  Fl2  +  £  A,(Q  +  mmr)Cj 

i  =  1 

qAaqct+v12 

Csi->/i2+  £  /MC  +  w/mt)CT 

I  s  1 


1.  Introduction 

The  quadratic  performance  criterion 

s 

J=  £  JCT(*)/?i JC<*)  mt(/c)/?2w(A:)  (l) 

k  =  0 

expresses  the  desire  to  minimize  deviations  of  the  state  x(/t)  of  the  system 

x(/c  +  l)  =  Ax(k)  +  Bu(k)  +  Hik)  (2) 

from  the  regulation  point  x  =  0.  As  is  well  known  (Kwakernaak  and  Si  van.  1972, 
pp.  504-509),  the  non-zero  set  point  criterion 

Jx  =  £  [x(k)  -  x]TR,[x(k)  -  x]  +  uT(k)R2u(k)  (3) 

k  =  0 

presents  no  additional  difficulty  so  long  as  x[k)  and  u{k)  are  replaced  by  x(k)  -  x  and 
u(k)  -  u,  where  u  satisfies 

x  =  Ax  +  Bit  (4) 

Closer  inspection,  however,  reveals  that  this  approach  is  suboptimal.  Specifically, 
the  offset  it  in  the  control  may  correspond  to  an  unacceptably  high  level  of  control 
effort  when  uTRzu  is  large.  Hence  (3)  overlooks  design  tradeoffs  concerning  the 
control  effort  required  for  maintaining  the  non-zero  regulation  point  x.  Moreover, 
such  an  approach  is  impossible  when  u  satisfying  (4)  does  not  exist. 

A  significant  advance  in  extending  the  full-state-feedback  LQR  formulation  to 
steady-state  periodic  tracking  problems  (and  hence  to  the  special  case  of  non-zero 
set  point  regulation)  was  given  by  Artstein  and  Leizarowitz  ( 1985).  Bernstein  and 
Haddad  ( 1987  b)  generalize  the  results  of  Artstein  and  Leizarowitz  ( 1985)  for  the  non¬ 
zero  set  point  regulation  problem  to  include  noisy  and  non-noisy  measurements, 
weighted  and  unweighted  controls,  correlated  plant/measurement  noise,  cross  weight¬ 
ing,  non-zero  mean  disturbances,  and  state-,  control-  and  measurement-dependent 
multiplicative  white  noise.  They  consider  the  steady-state  performance  criterion 

7=  lim  E[(Lx(r)  -  d)TR|(Lx(t)  -  d)  +  2(Lx(t)  -  <5)T/?,2u(r)  +  ur(t)R2u(t)]  (5) 
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where  8  is  the  non-zero  regulation  point.  For  full-state  feedback  with  R , 2  =  0  and 
L  =  identity,  Artstein  and  Leizarowitz  (1985)  show  that  for  a  constant  offset  control  law 


u(t)  =  Kx(t)  +  ot 

K  and  a.  are  given  bv 

K=  -  R^BrP 
a  =  -Ril  BT(A-ZP)-TRl8 


(6) 

(7) 

(8) 


where  P  satisfies  the  Riccati  equation 


with 


0  =  AT P  +  PA  +  Rj  -  PXP 
I  4  BR;'BJ 


Two  features  of  the  control  law  (6)— (8)  are  noteworthy.  First,  (6)  consists  of  both  a 
closed-loop  feedback  component  Kx(t)  and  an  open-loop  component  a  depending 
upon  the  regulation  point  <5.  And,  second  (and  more  important),  is  the  observation 
that  the  closed-loop  control  component  is  independent  of  the  open-loop  component. 
From  a  practical  point  of  view  this  feature  is  quite  useful  since  it  implies  that  the 
feedback  gain  K  can  be  determined  without  regard  to  the  set  point.  Hence  a  change  in 
the  desired  set  point  8  during  on-line  operation  does  not  necessitate  re-solving  the 
Riccati  equation  in  real  time;  only  a  requires  updating.  For  a  new  value  of  8 ,  a  can 
readily  be  recomputed  on-line  via  the  matrix  multiplication  operation  (8).  In  the 
presence  of  multiplicative  disturbances,  however,  the  independence  of  the  closed-loop 
component  from  the  open-loop  component  is  lost. 

The  purpose  of  the  present  paper  is  to  provide  a  self-contained  derivation  of  the 
optimality  conditions  for  the  non-zero  set  point  problem  in  the  discrete-time  case.  To 
obtain  a  realistic  problem  setting,  we  consider  the  case  in  which  the  full  state  is  not 
available,  but  rather  only  noise-corrupted  measurements  of  linear  combinations  of 
states  For  greater  design  flexibility,  we  also  allow  the  possibility  for  correlated  plant 
and  measurement  noise.  In  addition,  we  consider  the  dual  design  feature,  namely, 
cross  weighting  in  the  performance  criterion.  The  presence  of  a  non-zero  constant 
plant  disturbance  in  conjunction  with  zero-mean  white  plant  disturbances,  i.e.  a  non¬ 
zero  mean  disturbance,  is  also  considered.  Our  results  show  that  the  presence  of  a 
non-zero  constant  disturbance  component  leads  to  an  additional  offset  in  the  open- 
loop  component  of  the  control.  Finally,  in  addition  to  the  above  generalizations  we 
allow  for  the  presence  of  multiplicative  disturbances  in  the  plant.  The  control  law  thus 
generalizes  previous  results  involving  state-,  control-  and  measurement-dependent 
noise  (Bernstein  and  Haddad  1987).  As  shown  in  Bernstein  and  Greeley  (1986)  and 
Haddad  ( 1987),  the  multiplicative  white  noise  model  can  be  used  for  robustness  with 
respect  to  plant  parameter  variations. 


2.  Non-zero  set  point  regulation 

2.1.  Non-zero  set  point  problem 

Given  the  nth-order  controlled  system 

x(k+  1)  =  +  £  vi(k)A,'jx(k)  +  (^B+  £  Vi(k)B^Ju(k)  +  w{(k)  +  y  (9) 
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with  measurements 

y{k)  =  ^C+  £  vi(k)Ci'jx(k)  +  w2(k)  ( 10) 

where  k  =  1, 2, ....  determine  K  and  a  such  that  the  static  output  feedback  controller 

u(k)  =  Ky(k)  +  a  (11) 

minimizes  the  steady-state  performance  criterion 

J(K,  a)  ^  lim  E[(Zjc(A:)  -  SfR^Lxik)  -S)  +  2(Lx(k)  -  S)rRi2u(k )  +  uT(k)Rzu(k)] 

k-*ao 

(12) 

Using  the  notation  of  §  1  the  closed-loop  system  (9)-(  1 1)  can  be  written  as 

x(k  +  1)  =  +  £  »,( k)A^j  x(k)  +  B  +  £  v,{k)B,  +  w(k)  (13) 

To  analyse  (13)  define  the  second-moment  and  covariance  matrices 
Q(k)  A  E[x(k)xJ(k)l  QW  *  Q(k)  -  m(k)mT(k ) 
where  m(k)  ^  E[x(k)].  It  follows  from  (13)  that  Q(k),  Q(k)  and  m(k)  satisfy 
Q(k  +  1)  =  AQ(k)Ar  +  Am(k)BT  +  BmT(k)Ar  +  BBT 

+  £  LAiQ(k)A]  +  SimT(fc)/?iT  +  AMk)B?  +  BjflT]  4  P  (14) 

i=  1 

Q(k  +  1)  =  AQ(k)AT  +  £  iA]Q(k)A?  +  AMk)mJ(k)A fT 

i  ~  1 

+  BimT(k)^iT  +  ^^(/c)^1]  +  p  (15) 

m{k+ l)  =  Am(k)  +  B  (16) 

To  consider  the  steady  state,  we  restrict  our  consideration  to  the  set  of  closed-loop 
second-moment  stabilizing  gains 

S,^  :A®A+  £  /4j®  Aj  is  asymptotically  stable 

It  follows  from  fundamental  properties  of  Lyapunov  equations  that  if  K  e  S„  then 
A  is  also  asymptotically  stable.  Hence,  for  K  e  S„  Q  ^  lim  Q[k),  Q  ^  lim  Q[k)  and 

k—  x  k-»  x 

lim  m(k)  exist  and  satisfy 

k-*oo 

Q  =  AQAJ  +  AmBr  +  BmrAT  +  SB T 

+  £  lAiQA?  +  Bitn1  A?  +  AtmB?  +  S,S,T]  +  V  (17) 

i*  l 

Q  =  AQA1  +  £  tA,QAj  +  A{mmTA,J  +  B,mT  A?  +  A{mBj  +  B,B,T]  +  P  (18) 

t  =  1 

m  =  A- 1 B  (19) 

Note  that  since  A  is  asymptotically  stable,  the  inverse  in  ( 19)  exists.  For  K  e  S,,  it  now 
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follows  that  J(K,  a)  is  given  by 

J(K,  <x)  =  tr  [(<2  +  mmT)£]  +  tr  \_KrR2  KKJ  +  SrRld  -  2mTLrRi  L6 

+  2mTLTR12a  -  2 SrRl2KCm  -  2 SrR12ot  +  2mTCTKrR2x  +  aTR2a  (20) 
Associated  with  Q  is  its  dual  P  >  0  which  is  the  unique  solution  of 

P  =  ArPA+  £  A?PAi  +  R  (21) 

i*  1 

To  obtain  closed-form  expressions  for  the  feedback  gain  K,  we  further  restrict 
consideration  to  the  set 

S*  ^{Ke  Sj :  R2s  >  0,  V2s  >  0  and  ‘T,  is  invertible} 

where 

4'J^BTA-TLTR1LA'1B+STA'TLT/?12(/m  +  KCA-|B) 

+  Um  +  KC*-lB)TR]2LA-lB  +  (lm  +  KCA-lB)TR2[lm  +  KCA-lB) 

+  £  [B1  A~^  A?  PAtA~ 1 B  +  B] PA,A~ 1 B  +  Br  A~r  A]  PB; 

1=  1 

+  BT  PBt  +  BT  A ' ' T  Cj  KT  R2  KC, A  ~ 1 B] 

Furthermore,  we  assume  that 

[B,  #0=*Cj  =  0],  (=1 . p  (22) 

i.e.  for  each  j  e  { 1, p},  B,  and  C,  are  not  both  non-zero.  Essentially,  (22)  expresses 
the  condition  that  the  control-dependent  and  measurement-dependent  disturbances 
are  independent.  There  are  no  constraints,  however,  on  correlation  with  the  state- 
dependent  noise.  For  the  statement  of  the  main  theorem  define 

A,±  BTA~TLT(RlL+  Rl2KC)A~l  +(/n  +  KCA-‘B)T(Rl2L+R2KC)A-' 

+  £  ([.4,A~lfl  +  B,]rPAfA~l  +  BtA'tC7KtR2KC,A~') 

i  =  1 

Q*  BTA-TLTR2L  +  RJ2L+  BtAtCtKtRJ2L 

Theorem  2.1 

Suppose  K  and  x  solve  the  non-zero  set  point  problem  with  K  e  S,+ .  Then  there 
exist  n  x  n  Q,  P  ^  0  such  that 

K=  -R2,l[BTPAQCr  +  PsiQCT  +  BTPQsl)V2-s'  (23) 

*=  -^-'[A.y  +  n^]  (24) 

and  such  that  Q  and  P  satisfy 

Q  =  AQA 1  +  K,  +  £  [(.4,  +  BjKQQlAi  +  B,KC)T  +  B,KF2KtB7  +  /4,mmT^T 

t  =  1 

+  BmT4,T  +  A,mBJ  -f  B,B,T] 

+  ( Qs  +  BK  V2 , )  Vf, 1  ( Q,  +  BK  V2,  )T  -  Q,  V2i  Qj  (25) 

P=  4rPA  +  R^  +  £  [Mi  +  BKCf)TP(/tj  +  BKCj)  +  CjKTR2KCi 

I*  1 

+  (P,  +  R2jKC)tR2- '(P5  +  R2sKC)  -  PjR2sP,]  (26) 
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Proof 

The  derivation  of  the  necessary  conditions  is  a  straightforward  application  of  the 
Lagrange  multiplier  technique.  To  optimize  (20)  over  S*  subject  to  the  constraints 
(18)  and  (19),  form  the  lagrangian 


L (K,  a,  Q,  P ,  m)  A  tr  \^.0J(K,  a)  +  ^AQA7  4-  £  [A,QA7  +  A,mmT  A7  +  8,mTA? 

+  AimB?  +  BjfiT]  +  V  -  Q^jP  +  )?(Am  +  B  -m)l 


where  the  Lagrange  multipliers  A0  ^  0,  k  e  R"  and  P  e  R"  * "  are  not  all  zero.  Setting 
dL/dQ  =  0  and  using  the  second-moment  stability  assumption  it  follows  that  /.0  =  1 
without  loss  of  generality.  Thus  the  stationarity  conditions  are  given  by 


^  =  A7PA  +  £  A?PAi+R-P  =  0  (27) 

cV.  .  p  ^  ^  ^  ^  ^  «... 

—  =  AQA7  A-  Y  [AjQA?  +  Aiinm7 A?  -I-  B.m1/!,7  +  A^B 7  +  B,B,r] 

OP  i=i 

+  V-Q  =  0  (28) 


— T=Am  +  B-  m  =  0  (29) 

o/' 


—  =  R2sK  V2,  +  R72  QC7  +  B7  PAQC7 


+  f  lBiPAiQC  +  B7PAi(Q  +  mm7)Cj-\  +  BTPVi2  =  0  (30) 

»=  1 

^  =  £  [BfPAim  +  Bj PBtKC  +  S,TPB,x]  +  \b7 /.  +  R]2Lm 
dot  /T)  2 

~R]2S  +  R2KCm  +  R2<x  =  0  (31) 

^-Km+  Y  [/l/PB,  +  ^P^jm]  -  ^ATA  -  LTR,<5  +  LTR12x 
cm  i  - 1  2 

-  CtKtR[2<5  +  C7 K7 R2ot  =  0  (32) 

/  =  2A~T ^Rm  +  £  [/4I3PB1  +  41PA3m]-LTR1d  +  LTR12a 

-CTKTRy2c5  +  CTKTR2^  (33) 

Using  the  definitions  for  Qsl  and  P5l  along  with  (33),  we  obtain  (23)  and  (24). 
Substituting  the  expressions  for  the  optimal  gains  into  (27)  and  (28)  yields  (25)  and 
(26).  □ 

Remark  1 

Because  of  the  presence  of  6  in  (25)  via  m  in  both  Qsl  and  Vi,  and  in  (25)  via  B 
(in  m)  and  8t,  the  closed-loop  component  of  the  control  law  (23)  cannot  be 
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determined  independently  of  the  open-loop  component.  As  shown  in  the  following 
section,  independence  is  recovered  when  the  multiplicative  noise  terms  are  absent. 

Remark  2 

To  specialize  Theorem  2.1  to  the  standard  regulation  problem,  set  <5  =  0  and  y  =  0 
yielding  Theorem  2.1  of  Bernstein  and  Haddad  (1987  a). 

3.  Specializations  of  Theorem  2.1 

A  series  of  specializations  of  Theorem  2.1  is  now  given.  We  begin  by  deleting  all 
multiplicative  white  noise  terms,  i.e. 

Ah  B„  C,  =  0,  /  =  I - p  (34) 

In  this  case  the  stabilizing  set  Ss  can  be  characterized  by 
S  =  [K :  A  is  asymptotically  stable] 
and,  furthermore,  S,+  becomes 

S*  ^  {K  eS:  R2a>0,  F2a  >  0  and  is  invertible] 

where 

'Va ^  BTA^TLTRlLA-1  B+  BTA~T  LTRl2[lm  +  KCA  1 B) 

+  (/n  +  KCA-lB)TR]2LA-'B  +  (lm  +  KCA~'B)TR2{lm  +  KCA~'B) 

For  the  statement  of  Corollary  3.1  define 
\a±  BJA~r Lr(R,L  +  Rl2KC)A~l  +{lm  +  KCA  'B)t(R]2L+  R2KC)A~' 

Corollary  3.1 

Assume  (34)  is  satisfied  and  suppose  K  and  x  solve  the  non-zero  set  point  problem 


with  Kg  S  + .  Then  there  exist  n  x  n  Q,  P^O  such  that 

K  =  -  R2J 1  (  Bt  PAQCt  +  R]2QCT  +  Bt  PVl2)  Vfa  1  ( 35) 

-'P.-'tA.y  +  lM]  (36) 

and  such  that  Q  and  P  satisfy 

Q  =  AQAt  +V[+(Qa+BK  V2a)V2-  ‘{Qa  +  BK  V2Jr  -  Qa  V2aQj  (37) 
P=AtPA  +  R,+(Pa+  R2aKC)JR2a'iPa  +  R2aKC)  -  PxaR2aPa  (38) 
Finally,  setting 

y  =  0,  Rl2=  0,  F,  2  =  0.  r  =  n,  L=In  (39) 


we  obtain  the  discrete-time  version  of  Artstein  and  Leizarowitz  ( 1985)  for  the  case  of 
output  feedback.  Define 

S,+  £  {K  6  S :  R2a  >  0,  V2a  >  0  and  VF1  >  0] 

where 

*F,  4  BrA-TR:A'i  B  +  Um  +  KCA'iB)JR2(Im  +  KCA~ 1 B) 

Corollary  3.2 

Assume  (34)  and  (39)  are  satisfied  and  suppose  K  and  x  solve  the  non-zero  set 
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point  problem  with  K  e  Sf  ■  Then  there  exist  n  x.  n  Q,  P^Q  such  that 

K  =  —  R2- 1  BT PAQCr  V2: 1  (40) 

a=  -'F,~  lBTA'TRl5  (41) 

and  such  that  Q  and  P  satisfy 

Q  =  AQAr  +  F,  +  (  AQCt  +  BK  V2a)V2~  l(AQCJ  +  BK  K2a)T 

-AQCTY2aCQAT  (42) 

P=AtPA  +  R,  +  (BT  PA  +  R2aKC)TR2ai(BTPA  +  R2aKC) 

-  AJPBR2aBTPA  (43) 


4.  Directions  for  further  research 

The  extension  to  fixed-order  dynamic  compensation  for  non-zero  set  point 
regulation  appears  possible  using  the  approach  of  Hyland  and  Bernstein  (1984) 
and  Haddad  (1987).  A  generalization  of  Theorem  2.1  to  design  periodic  tracking 
controllers  (either  static  or  dynamic)  via  the  parameter  optimization  approach  is 
being  developed. 
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Optimal  Nonzero  Set  Point  Regulation  Via  Fixed-Order 
Dynamic  Compensation 

WASSIM  M.  HADDAD  and  DENNIS  S.  BERNSTEIN 

Abstract — Standard  LQG  control  theory  is  generalized  to  a  regulation 
problem  involving  specified  nonzero  set  points  for  the  state  and  control 
variables  and  nonzero-mean  disturbances.  For  generality,  the  results  are 
obtained  for  the  problem  of  fixed-order  (i.e.,  not  necessarily  full-order) 
dynamic  compensation.  When  the  state,  control,  and  disturbance  offsets 
are  set  to  zero  and  the  compensator  order  is  set  equal  to  the  plant 
dimension,  the  standard  LQU  result  is  recovered.  These  results  provide 
the  dynamic  counterpart  for  the  nonzero  set  point  regulation  results 
obtained  in  |1|  via  static  controllers. 


I.  Introduction 


As  discussed  in  (1|,  the  standard  quadratic  performance  criterion 
expresses  the  desire  to  maintain  the  state  and  control  variables  in  the 
neighborhood  of  the  origin.  If  regulation  is  desired  about  nonzero  state 
and  control  offsets,  then,  in  special  cases,  the  set  points  can  be  translated 
to  the  origin  and  standard  theory  can  be  applied  (see.  e.g..  {2.  pp.  270- 
276]).  In  general,  however,  (see  [1])  such  a  translation  may  either  be 
suboptimal  or  impossible.  The  latter  situation  may  occur,  for  example,  if 
the  number  of  state  components  with  specified  nonzero  set  points  is 
greater  than  the  number  of  controls,  while  the  former  is  the  case  when  the 
control  offset  is  particularly  costly. 

Motivated  by  the  work  of  Leizarowitz  and  Artstein  [3],  [4]  on  the  more 
general  problems  of  periodic  and  nonperiodic  tracking,  the  nonzero  set 
point  problem  was  addressed  in  [I]  for  the  case  of  static  output-feedback 
controllers.  The  goal  of  the  present  note  is  to  derive  analogous  results  for 
the  case  of  dynamic  compensation  considered  by  Leizarowitz  in  (5|.  As  in 
[1],  the  solution  we  obtain  has  the  satisfying  feature  that  the  closed-loop 
dynamic-feedback-compensation  gains  are  independent  of  the  open-loop 
control  components  which  arise  from  the  state  and  control  set  points. 
Thus,  if  the  state  set  point  is  changed  during  operation,  then  only  the 
open-loop  control  components  require  updating.  Consequently,  there  is 
no  need  to  recalculate  the  closed-loop  gains  by  solving  Riccati  equations 
in  real  time  The  overall  theory  thus  permits  the  treatment  of  step 
commands  within  standard  LQG  theory. 

For  generality  the  development  herein  incorporates  several  special 
features  which  provide  additional  flexibility  in  applications.  These 
include:  1)  constant  disturbance  vectors  in  addition  to  zero-mean  additive 
plant  and  measurement  noise  (i.e..  nonzero-mean  disturbances):  2) 
correlated  plant  and  measurement  noise;  3)  state/control  performance 
cross-weighting.  4)  arbitrary  set  points  for  selected  linear  combinations  of 
the  state  and  control  variables  (sec  L ,  and  L:  in  the  problem  statement  in 
Section  III),  and  5)  fixed-order  (i.e.,  full-  or  reduced-order)  compensa¬ 
tion.  Because  of  the  last  feature,  the  results  obtained  in  the  present  note 
also  generalize  the  results  of  |b| .  For  clarity ,  we  specialize  the  main  result 
to  the  usual  full-order  LQG  case. 


II.  Notation  and  Definitions 

fl,  Si'",  Si',  2.  Real  numbers,  r  y  s  real  matrices.  Si"  ', 
expectation. 


/„.<  )r.<  )' 


asymptotically 
stable  matrix 
n,  m,  I,  q,  r,  nc 
n 

x,  «,  y,  xc,  £ 

A,  B,  C,  D 
Ac,  Be,  Cc 
Lx,  L, 

6„  6: 

7i»  7: 
a,  otr 


£,  i,  a 


*■,</).  w,(l) 

V,,  V ; 

V,2 

w(t),  V 

RuRi 

R,2 


8 

A,  B 
m,  mc 

m 


R\ 


N,  § 


n  x  ft  identity,  transpose,  group  generalized 
inverse. 

Matrix  with  eigenvalues  in  open  left-half  plane. 


Positive  integers. 
n  +  nc. 

n,  m,  I,  nc,  n -dimensional  vectors. 
n  x  n,  n  x  m,  I  x  n,  /  x  m  matrices. 
nc  x  nr,  nc  x  /,  m  x  nc  matrices. 
q  x  rt,  r  x  m  matrices. 
q ,  r-dimensional  set  point  vectors. 
n,  /-dimensional  constant  disturbance  vectors, 
m,  nc -dimensional  control  vectors. 


::]  ■  W  •  [;] 


/-dimensional  zero-mean  white  noise  processes, 
ensities  of  w,,  w2;  K,  a  0,  V,  >  0. 
x  /  cross  intensity  of  W|,  uv 


W|(f) 

k 

Vv.B*  ' 

Brw2U) 

B  Vr 
_  V  12 

bcv2bi 

q  and  r  x  r  state  and  control  weightings: 
i  2  0,  /?2  2  0,  Z.f/fjZ.2  >  0. 
r  cross  weighting:  LfR,L,  - 
lXaL2{LlRiLl)-'LlXllLl  2  0. 

L\R,L,  L]R12L,Cc  1 
JL'R'L,  C?L[R2L:Cc]' 

4  BC ,  1  T  B  0  "j 

rC  /lr+BrDCrJ  1  [bc£>  /„J  • 

.--dimensional  vectors. 


lL,-LrR,:L:U.;R1L1)-'L’R[2L,  0 
0  n 

r;i,  LIR'L'C, 


:] 


R;L2)  '  0 
0  0 


I  I"  L  IR?L2  ol 

0  J  ’  L  0  oj 

:] 
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Ill.  Dynamic  Compensation  for  Nonzero  Set  Point 
Regulation 

A.  Nonzero  Set  Point  Problem 
Given  the  nth -order  stabilizable  and  detectable  plant 

xU)~AxU)  +  Bu(l)+w,V)  +  y,.  t  €  [0,  <*>),  (3.1) 

y(t)  =  Cx{t)  +  Du(t)  +  w2(l)  +  yi  (3.2) 

design  a  fixed-order  dynamic  compensator 

jrf(/)  =  /4fxf(/)  +  fl,>(r)  +  af,  (3.3) 

u(t)  =  Ccxr(t)  +  a  (3.4) 

which  minimizes  the  steady-state  performance  criterion 

J(AC,  C„  a.  of)  k  lim  3((Z.,jr(r)-5l)77?1(L,x(r)-6,) 

+  2(Llx(t)-6l)TRn(L1u(t)-&2) 

+  (L1uU)-6:)TR:(L'Mt)-62)].  (3.5) 

Remark  3.1:  The  cost  functional  (3.5)  is  identical  to  the  LQG  criterion 
(usually  stated  in  terms  of  an  averaged  integral)  with  the  exception  of  the 
shifted  set  points  6,  and  6-  and  matrices  L ,  and  L2  for  selecting  linear 
combinations  of  components  of  x  and  u. 

The  closed-loop  system  (3.1)~(3.4)  can  be  written  as 

S(r)  =  Ax(t)  +  Bd  +  *»(/)  +  >,  t  €  (0,  oo)  (3.6) 

where  x(t)  =  \xr(t),  xf(t)\T  and  the  closed-loop  disturbance  w(r)  has 
nonnegative-definite  intensity  To  analyze  (3.6)  define  the  covariance 
matrix 

Q(t)  =  E((jf(r)  -  m(t)Kx(r )  -  m(r ))  r|  =  £(x(r)ir(r)]  -  »n(r)r#i  r(f ) 

where  m(r)  =  £|.v(f)]  As  shown  in  [I],  Q(t)  and  rfi(t)  satisfy 

Qu)  =  AQ{i)  +  Q{t)A  '+  V,  (3.7) 

rfiil)  =  AmU)  +  6a  +  y.  (3.8) 

To  guarantee  that  7  is  finite  and  independent  of  initial  conditions,  we 
restrict  our  attention  to  the  set  of  admissible  stabilizing  compensators 

s>  =  l(/4, .  B  .  C  ):  A  is  asymptotical!)  stable}. 

Hence,  for  (Ac,  B,,  C)  £  S,  3  s  lim,  ..  Q(t)  and  ms  lim,-.  m(l) 
exist  and  satisfy 

0  =  AQ  +  QAT+V,  (3.9) 

0  =  /(rfi  +  Ai  +  y.  (3.10) 


generality  we  further  restrict  our  attention  to  the  set 

S'  k  {(At,  Bc,  C,)  e  S:  (Ac,  Bc )  is  controllable 

and  (Ar,  Cr )  is  observable}. 

Now  J(Ae,  Bc,  Cc,  or,  ac)  is  given  by 

J(AC,  Bc,  Cc,  a,  af)  =  tr  [Q  + rhmT]8 -2mTLjR,6,  + &*R,6, 

+  2m  TL  lRnL2a  -  2m  TL  *Rl2S2 
—  26  iRuLiCem,  —  26  *  R ,2L2ot 
+  26[R,:6-  +  2mTcCTcLlR:L,a- 2mJCfL  [Rj6; 
-2aTLlR262  +  aTLT2R2L2n  +  6r2R262.  (3.11) 

To  obtain  closed-form  expressions  for  the  feedback  gains  we  further 
restrict  consideration  to  the  set 

S'  i  {(A,,  Be,  Cc)  6  S':  0>0}. 

where 

0  k  BTA-TA,A-'B+(P,2A  'S-R^r/f'fRnA  'B-Bu). 

The  following  factorization  lemma  is  needed  for  the  statement  of  the 
main  result. 

Lemma  3.1:  Suppose  n  x  n  Q,  P  are  nonnegative  definite  and  rank 
QP  =  nc.  Then  there  exist  nc  x  n  C,T  and  nc  x  nc  invertible  M such 
that 

QP=GTMT,  (3.12) 

r  G (3.13) 

Furthermore.  C,M,  and  T  are  unique  except  for  a  change  of  basis  in  JlV 
Proof:  See  [6}.  C 

As  shown  in  [6],  QP  has  a  group  generalized  inverse  (QP)‘  = 

C  TM  1 T,  and  the  matrix 

r  k  QP(QP)'  =  GTT  (3.14) 

is  an  oblique  projection.  A  triple  (G,  M,  T)  satisfying  (3. 12)  and  (3.13) 
with  G,  T  €  fi”< M  €  and  n,  =  rank  QP  will  bc  called  a 

projective  factorization  of  QP  Furthermore,  define  the  complementary 
projection  r,  k  f„  -  r.  Optimizing  (3.11)  subject  to  (3.9)  and  (3.10) 
yields  the  following  result  illustrated  in  Fig  I. 

Theorem  3.1:  Suppose  (Ac,  Bc,  Cc,  a,  ac)  solves  the  nonzero  set  point 
problem  with  (A,,  Bt,  C.)  6  S'.  Then  there  exist  n  x  n  nonnegative- 
definite  matrices  Q,  P,  Q,  P  such  that,  for  some  projective  factorization 
(G,  M,  T)  of  QP,  Ac,  Be.  Cc,  a,  and  ac  are  given  by 

Ar=r\A-B(LZR,L2)  'P.-Q.V;'C+Q.V:'D(LIR2L2)-'P.\Gt, 

(3.15) 

Bc=TQ.y-\  (3.16) 


C,=  -(LIR2L2)-'P.Gt,  (3.17) 

[;]  ‘Q-'l(P,l-BrA-rP)A  'yHft-BTy(-T5)S]  (3.18) 


Since  the  value  of  J  is  independent  of  the  internal  realization  of  the 
transfer  function  corresponding  to  (3.3)  and  (3.4),  without  loss  of 
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and  such  that  Q,  P,  (5,  and  P  satisfy 

0  =  AQ  v  QA  r+  V,  -  Q.  V- '  Q[+  rx  Q.  V  - ' Q^r  r  (3. 19) 

0  -  A  r/>+  PA  +  L  fK,  L,  -  PT,(L  [*:Lj)  - 1 P, 

+  TTlPl(LTRtLt)-'P.T1,  (3.20) 
0  =  A/.C+QATp+QJ'j'Ql-riQ.V;'QlTTx.  (3.21) 

0**Agfl+  PAq  +  PULlRiL,)  -'P.-r\  Pl(L[RiLi) * ' P.r.  .  (3.22) 
rank  $-rank  ^=nink  QP=nt.  (3.23) 

Proof:  See  Section  (V.  □ 


Remark  3.2:  The  results  of  (6)  are  a  special  case  of  Theorem  3.1 .  To 
see  this  set  6,  =  yi  =  0.  63  =  0,  y2  =  0,  L,  =  /„,  and  L2  =  /„,  which 
yields  the  results  of  |6|  with  the  added  features  of  correlated  plant/ 
measurement  noise  (  k'l;).  cross  weighting  (/?,;),  and  a  direct  transmission 
term  (£>)  in  the  plant  dynamics 

As  discussed  in  |6).  in  the  full-order  (LQG)  case  n,  -  n  the  Lyapunov 
equations  (3.21)  and  (3  22)  for  £and  Pare  superfluous.  In  this  case  C  = 
T  1  and  thus  G  =  T  =  r  =  /„  withou'  loss  of  generality.  To  develop 
further  connections  with  standard  LQG  theory,  assume 

L,  =  =  0.  f,;  =  0  (3.24) 

and  define 

*  •[:  u  »[::]• 

In  this  case  S  *  becomes 

S  *  4  {(Ar,  B,,  C,)  6  S  ':  fl>0) 

whet*e 

ft  4  iM  rM  ,5+(<Rij/C-,5-<S|2)r(R'!((Rii/f-15-(Si2). 


Corollary  3.1:  Let  /tr  =  n,  assume  (3.24)  is  satisfied,  and  suppose 
(Ac,  Bc,  Cc,  a,  ac)  solves  the  full-order  nonzero  set  point  problem  with 
(Ac,  Bc,  Cc)  6  §  ' .  Then  there  exist  n  x  n  nonnegative-definite  matrices 
Q,  P  such  that  Ac,  Bc,  Cc,  a.  and  ac  are  given  by 

A  f  =  A  -  BR  - 1 B  TP  -  QC r  V; 1 C +  QC  7  V  -  >  DR  - '  B  TP, 

Bc~QCTV 

Cc- -R:'BTP, 

=  b-'H&l3-BTA-T&)A-'y  +  <,$l-6TA-T$)S} 

and  such  that  Q,  P  satisfy 

0  =  AQ  +  QA  T+  \\-QCTV-'CQ. 

0  =  ATP  +  PA+R,-PBR}'B1  P. 

Remark  3.3:  Note  that  by  setting  6,  =  y,  =  0,  6;  =  C,  y:  =  0,  and  D 
=  0.  Corollary  3  1  yields  the  standard  LQG  result. 

Remark  3.4:  It  is  easy  to  see  that  in  the  full-order  case  rr,  =  n  a 
solution  to  the  nonzero  set  point  problem  exists  as  long  as  f)  is  positive 
definite.  In  the  reduced-order  case,  however,  the  situation  is  more 
complex.  For  details,  sec  |8). 

IV  Proof  of  Theorem  3.1 

To  optimize  (3. 1 1 )  over  the  open  set  -S  ”  subject  to  the  constraints  (3 .9) 
and  (3.10).  form  the  Lagrangian 

S(Ar,  Br.  Cr,  a,  a, )  =  tr  { Cf,  a,  or,) 

+  {AQ+QAT  +  V)P+-kT(Am  +  Bd+y)) 

where  the  Lagrange  multipliers  2  0,  X  6  }i*.  and  P  €.  }{*  ■  *  are  not 
all  zero.  Setting  BS/dQ  =  0  and  using  the  fact  that  A  is  asymptotically 
stable,  it  follows  that  Xo  =  I  without  loss  of  generality  . 

Now  partition  n  x  n  Q,  P  into  n  x  n,  n  x  nc,  n,  x  n ,  subblocks  and 
X  6  tl*  into  I!"  and  W‘  components  as 


Q\  On 

.  r 

p u" 

_ 

Q\i  Q:  _ 

*  pT 

- ,j 

Pi  _ 

•  x=UJ 

Thus,  the  stationarity  conditions  are  given  by 


as. 


ATP+PA  +  fi=0, 


(4.2) 
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Om  2 


(4.3) 


d£ 
da  ' 


[Lr2R2L2  0] i  +  L^R2L2Cc]m-lL^Rl2  LIR2)S+\bt\,  +  X-DtBtc\2 


IXj 


(4.4) 


a  P  1 

7^j-  =  .P,rjOi:  +  ^>2G2  +  2  \2mj  =  0, 

3§  =  PiiVn+P,B'V1  +  WJQl  +  P1QTt)CT+{Pl2Qli  +  P2Q1)C!DT+,-\1n,TCT+1-\2yl+'-\2arDT=0. 

a  P 

—  =  LT2RTnL<Qn  +  HR2L2C'Q2  +  LlRT„LimmTc+  LlR2L2C'mtmT'+  BT(PiQtl  +  Pi2Q2)  +  DTBTt(PT„Qu  +  P2Q2)- LlR^ml 

,r  > 


(4.5) 

(4.6) 


+  L \R2L2amTc  -  LT2R2&2mTc  y  ^  BT\,mJ  =  0.  (4.7) 


Expanding  (4.1)  and  (4.2)  yields 

0  =  AQ,  +  Q\A  r+  V,  +  BC'Q\2  +  Q12CJB T.  (4.8) 

0  =  AQl2  +  Ql2Al+BCcQ2  +  Q,CTBJ+  yl2Bj+Q,2CjDTBj.  (4.9) 

0  =  Ac  Q:  +  &/I  C(?l2  +  Qj2CrBj  +  B,  y2BJ 

+  BcDC'Q2  +  C?2c;z>  rBf,  (4.10) 

0  =  y4rf»,  +  ^,/(  +  Z.f/?lLl  +  CTfl,r/,fJ  +  /,,jflfC.  (4.11) 

0  =  A  r/>,!  +  +  CTBJP2  +  PiBCr  +  L  \Ri2L2C(  +  Pl2BcDC,,  (4.12) 

0  =  /4  f/>j  +  P,/lf  +  CJS  r/>,j  +  PrnBCe+CrtL  T2R2L2Cc 

+  CTcDTBJP2  +  P2BrDCr.  (4.13) 

Next,  note  that  (4.4)  implies  that  X3  =  0,  and  thus  (4.5)  can  be  written 
as 

-Pi'pT2Q,2Q;'  =  I.c.  (4.14) 

The  existence  of  Q- 1  and  P~ '  follows  from  the  fact  that  (A<,  Bc,  Cc)  is 
minimal.  See  [6)  for  details  Now  define  the  n  x  n  matrices 

Q  i  Q,-Qr.Q:'Q*2.P  6  p,- pi2p2'PJ2. 

<5  A  QnQ2'Q*2,Pk  p»p;'p12. 

r  ft  -Q»Q;'P;'P» 

and  the  n,  x  rt,  nr  x  ne,  and  rte  x  n  matrices 

G  ft  0,'Qji*  M  ft  q.p2,  r  ft  -Pi'P\v 

Note  that  r  =  OT.  Clearly.  Q,  P,  £5,  and  P  are  symmetric  and 
nonnegative  definite 

Next  note  that  with  the  above  definitions,  (4.14)  is  equivalent  to  (3.13) 
and  that  (3.12)  holds.  Hence,  r  =  CT  is  idempotenl,  i.e.,  rJ  =  r. 
Sylvester's  inequality  yields  (3.23)  Note  also  that 

<2  =  r(5,  P=Pr. 

The  components  of  Q  and  P  can  be  written  in  terms  of  Q,  P,Q,  P,  G, 
and  r  as 

e.’Q  +  $.  P,-P+P. 

Q,2~G rr.  pi2=-Pgt, 

Qj-T(Jrr  P2 - cPc T. 

The  expressions  (3.16)  and  (3.17)  fotlow  from  (4.6)  and  (4.7)  by  using 
the  nr  and  n  components  of  (4.4),  respectively,  and  the  above  identities. 
Next,  computing  either  r(4.9H4. 10)  or  G(4. 12)  +  (4.13)  yields  (3.15). 


Substituting  this  expression  for  Ac  into  (4.8)-(4.13)  it  follows  that  (4.10) 
=  T(4.9)  and  (4.13)  =  G(4. 12).  Thus,  (4. 10)  and  (4.13)  are  superfluous 
and  can  be  omitted.  Next,  using  (4.8)  +  G1T(4.9)G  -  (4.9)G  - 
I(4.9)G)r  and  G*r(4.9)G  -  (4.9)G  -  [(4.9)G]r  yields  (3.19)  and 
(3.21).  Using  (4.11)  +  TrG(4.I2)r  -  (4.12)T  -  [(4.12)rjr  and 
rrG(4.12)r  -  (4.12)T  -  l(4.12)r)r  yields  (3.20)  and  (3.22). 

To  obtain  (3.18)  note  that  (4.4)  can  be  rewritten  as 

82a  +  Rl2m-r}S+^  8ri.  =  0.  (4.15) 

Next,  note  that  (4.3)  is  equivalent  to 

2  X*  —  A  T8m  +  A  ~TSS~A  "  rjf|r!o.  (4.16) 

Substituting  (4.16)  into  (4.15)  yields 

iR2-8TA-r8l2)a  +  (8l2-6rA-rR)m  +  (,6rArS-tf)6=0.  (4.17) 

Next,  note  that  (3.10)  is  equivalent  to 

m=  -A'Bci-A'y.  (4.18) 

Now,  substituting  (4.18)  into  (4.17)  yields 

(8,  -  8 r.A  - ' B  -  8  TA  -  TR  lt  +  8  T A  T8A  1  B)a  =  ( S  -  8  T A  -  TS)b 

+  (8,2~BTAT8)A'y.  (4.20) 

Finally,  note  that  the  coefficient  of  a  in  (4.20)  is  equivalent  to  0  and  thus 
(4.20)  yields  (3.18).  □ 

V.  Concluding  Remarks 

The  results  of  the  present  note  can  be  combined  with  the  results  of  [  1  ]  to 
obtain  nonstrictly  proper  controllers  leading  to  a  generalization  of  |7J. 
Current  research  is  focused  on  extending  the  results  of  the  present  note  to 
larger  classes  of  command  and  disturbance  signals. 
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A  Study  of  Controllability  and  Time-Optimal  Control  of 
a  Robot  Model  with  Drive  Train  Compliances  and 
Actuator  Dynamics 

A.  AILON  and  G.  LANGHOLZ 

Abstract — The  problems  of  robot  controllability  and  time-optimal 
control  where  drive  train  compliances  and  actuator  dynamics  are 
incorporated  in  the  mathematical  model  is  the  subject  of  this  note.  This 
study  demonstrates  the  conditions  that  ensure  the  existence  of  a  time- 
optimal  control,  and  establishes  controllability  of  the  augmented  model 
(robot  and  actuator)  in  open-  and  closed-loop  form.  This  note  describes  a 
procedure  for  the  derivation  of  easily  computable  functional  inequalities 
which  represent  upper  bounds  on  the  norm  of  the  augmented  system's 
time  response. 

I.  INTRODUCTION 

To  obtain  the  control  strategy  of  mechanical  manipulators,  various 
control  schemes  are  presented  in  the  available  literature.  A  few  examples 
are  resolved  control  [!J,  inverse  problems  technique  [2],  and  resolved 
acceleration  control  [3].  In  most  cases,  the  control  scheme  involves  the 
compulation  of  the  appropriate  generalized  forces  by  the  equation 

H{8)$a'  +  K(e.  0)  +  R(8)  =  q 

where  6  and  q  are  the  vectors  of  the  generalized  coordinates  and  forces, 
respectively.  H  is  the  moment  of  inertia  matrix.  A  is  a  vector  specifying 
centrifugal  and  Coriolis  effects,  and  R  is  a  vector  specifying  gravitational 
effects. 

In  much  of  the  literature  the  actuators  providing  the  drive  torques  are 
modeled  as  pure  torque  sources.  However,  this  approach  is  in  most  cases 
a  simplification  of  the  realistic  models  of  the  system  (-4]-[8J . 

The  objective  of  this  note  is  to  study  controllability  and  to  investigate 
the  conditions  which  ensure  the  existence  of  a  control  function  that 
transfers  the  augmented  model  of  the  mechanical  system,  the  actuator’s 
dynamics,  and  the  drive  train  s  compliances,  from  a  given  initial  position 
to  a  desired  target  in  a  minimum  time  The  nv  <i<-:  and  the  approach  are 
useful  for  the  design  of  a  linear  contr -'er  and  can  be  used  as  a  point  of 
departure  for  a  more  general  model  ot  a  robot  arm. 

II.  The  Mathematical  Model 

The  Lagrange  formulation  of  a  multilink  mechanical  system  is  given  by 
d{SL/d9l)/dt -dL/d$,  =  q„  i-1.2  •  n  (1) 

B 
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where  L  =  T  -  V.  T  and  V  are  the  kinetic  and  potential  energies  of  the 
system,  respectively. 

Let  p,  be  the  ith  generalized  momentum  [9].  Using  Legender's  dual 
transformation 

p,=  dL/d0„  1=1.2,  -  n.  (2) 

Since  L  is  a  quadratic  function  in  6U  p  is  linear  in  0  for  any  given  0,  i.e., 

A  =  2  '  =1.2,  ■n  (3) 

with  a,j(8)  =  dlL/d$,d6j. 

The  inertial  matrix  is  H  =  ( d1L/d8,d0J}„K„  with  del  (//)  =  h(6)  >  0, 
Vfi,  where  det  (•)  is  the  determinant  of  (•).  Now,  from  (1),  (2),  and  (3)  we 
have 

p,  =  9L/d$,+  q,,  i=  1.2,  •••/»,  (4) 

».=  26v(*)P,.  »- 1,  2,  •••.»!.  (5) 

J 

Using  (5)  one  obtains 

bU  98,=  [si*  («)p,p,  j  Adet  (H)):.  (6) 

Equations  (4)-(6)  constitute  the  state  equations  of  the  n-link  mechanical 
system  which  can  be  written  as 

t(r)  =  F(t(/))  +  fl?(0,  zfro)  =  *o  O) 

where  the  vectors  z  =  [pr0r]r,  q  =  Iq,q2  •  •  •  q„\T,  and  F  =  [F\F2  •  •  • 

] r  au-e  in  Euclidean  vector  space  with  the  usual  norm  ||z||2  =  , 

(z,)2.  We  also  have 

Frm  S  fwAPzJ  /l<*«  («))!.  4=  I,  2.  •  •  n 

2J  rf„p,^  /del  (//),  s  =  n  +  1,  t»  +  2,  •  •  •,  In 

and  B  =  [£).  where  /  is  the  n  x  n  identity  matrix 

As  an  example,  the  exact  equations  for  the  two-link  mechanical  system 
which  is  confined  to  move  in  the  vertical  plane  are  given  by 

p i  =  [PiP2/i/r2'"j  sin  (0:~0|)  det  (H)-[0.$p2ll1  +  0.Sp\(/l  +  m2t]) 
-plp2E)2EI,lc2m2  sin  (fr-  —  0,))/(det  (W))2 
-(m,g/. ,  +  m2g/,)  sin  9,  +  <7,  =  F,(p,.  p2.  fl2)  +  <?, 
p2  =  -\P\Ptl\lc'.tnz  sin  (»2-0,)  det  (H)- |0.5p2/2  +  0.5p2(/,  +  m2/J) 

~  PiP2E]2EI2l,2m2  sin  (9:-#,)]/(det  (W)): - m2glr2  sin  0:  +  q, 

-  F2(Pt,  p2,  0,.  02)  +  q2 

8l=(p,l2-p2E)  (H)  =  F2(pu  p2,  0,,  02) 

»,  =  (P:(/,  +  m2l])-p,E)/ det  («)  =  F.(p„  p2.  0„  8:)  (8) 

where  E  =  ti/c2m2  cos  (82  -  8,),  m,  and  /,  are  the  mass  and  the  length  of 
the  ith  link,  respectively,  I,  is  the  moment  of  inertia  of  the  ith  link  with 
respect  to  the  tth  joint,  and  l„  is  the  distance  from  the  tth  joint  to  the  center 
of  gravity  of  the  tth  link. 

The  term  det  ( H )  is  a  trigonometric  function  of.  and  periodical  in.  9, 
This  function  attains  its  minimum  in  the  interval  0  S  6,  s  2x,  i  =  1,  2, 
•  •  •  n,  and  therefore 

det  (H)2/t>0,  vt  6  R1’.  (9) 

We  turn  now  to  the  dynamics  of  the  robot's  drivers.  The  robot  is 
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Abstract 

The  problem  of  optimal  reduced-order  steady-state  state  estimation  is  considered  for  the  case 
in  which  the  plant  has  unstable  poles.  In  contrast  to  the  standard  full-order  estimation  problem 
involving  a  single  algebraic  Riccati  equation,  the  solution  to  the  reduced-order  problem  involves 
one  modified  Riccati  equation  and  one  Lyapunov  equation  coupled  by  a  projection  matrix.  This 
projection  is  completely  distinct  from  the  projection  obtained  in  Bernstein  and  Hyland,  1985,  for 
stable  plants. 
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1.  Introduction 


It  has  recently  been  shown  that  optimal  reduced-order,  steady-state  state  estimators  can  be 
characterized  by  means  of  an  algebraic  system  of  equations  consisting  of  one  modified  Riccati 
equation  and  two  modified  Lyapunov  equations  coupled  by  a  projection  matrix.  The  solution 
given  in  Bernstein  and  Hyland,  1985,  however,  was  confined  to  problems  in  which  the  plant  is 
asymptotically  stable,  while  in  practice  it  is  often  necessary  to  obtain  estimators  for  plants  with 
unstable  modes.  The  purpose  of  the  present  paper  is  to  obtain  results  similar  to  those  of  Bernstein 
and  Hyland,  1985,  for  unstable  plants. 

Intuitively,  it  is  clear  that  finite,  steady-state  state-estimation  error  for  unstable  plants  is  achiev¬ 
able  only  when  the  estimator  retains,  or  duplicates  in  some  sense,  the  unstable  modes.  Roughly 
speaking,  the  solution  given  in  Bernstein  and  Hyland,  1985,  is  inapplicable  to  the  unstable  problem 
for  the  simple  reason  that  the  range  of  the  projection  matrix  may  not  fully  encompass  the  unstable 
subspace.  Hence,  in  the  present  paper  we  derive  a  new  reduced-order  solution  which  is  constrained 
to  estimate  all  of  the  unstable  states.  Specifically,  for  a  plant  with  an  unstable  subspace  of  di¬ 
mension  nu,  we  characterize  the  optimal  estimator  of  order  nu  which  observes  all  of  the  unstable 
states. 

As  in  Bernstein  and  Hyland,  1985,  the  solution  is  given  in  terms  of  an  oblique  projection 
(denoted  in  the  present  paper  by  p)  which  characterizes  the  optimal  estimator  gains.  Again  in 
contrast  to  the  lone  observer  Riccati  equation  of  the  standard  full-order  theory,  the  optimal  reduced- 
order  estimator  gains  for  an  unstable  plant  are  given  by  an  algebraic  system  which,  in  the  present 
case,  consists  of  one  modified  Riccati  equation  and  one  Lyapunov  equation  coupled  by  the  projection 
matrix  p. 

It  is  important  to  stress  that  the  solution  derived  in  the  present  paper  is  fundamentally  different 
*  from  the  solution  obtained  in  Bernstein  and  Hyland,  1985,  for  two  reasons.  First,  the  estimator 
obtained  in  Bernstein  and  Hyland,  1985,  was  characterized  by  three  matrix  equations  (in  variables 
Q,Q ,  and  P)  while  the  solution  obtained  herein  involves  two  matrix  equations  (in  variables  Q 
and  P).  And,  second,  since  the  projection  p  arising  in  the  present  paper  depends  upon  P,  it  is 
completely  distinct  from  the  projection  r  appearing  in  Bernstein  and  Hyland,  1985,  which  depends 
upon  Q  and  P.  Hence  the  results  of  the  present  paper  neither  generalize,  nor  are  a  special  case  of, 
the  results  of  Bernstein  and  Hyland,  1985. 
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In  applying  the  results  of  the  present  paper  we  note  that  the  solution  is  applicable  to  problems 
in  which  the  unstable  subspace  also  includes  additional  stable  modes.  Indeed,  the  only  constraint 
in  applying  the  theory  is  that  the  unstable  subspace  include  all  of  the  unstable  poles.  To  clarify 
this  point  (see  Sections  2  and  3  for  notation)  we  note  that  all  unstable  poles  of  A  must  be  contained 
in  Au,  but  A„  may  also  contain  an  arbitrary  number  of  selected  stable  poles.  Thus,  the  estimator 
derived  in  the  present  paper  can  be  viewed  as  a  subspace-constrained  observer-estimator. 

Finally,  the  result  given  herein  is  only  a  partial  solution  to  the  reduced-order  estimation  prob¬ 
lem.  Specifically,  a  reduced-order  estimator  which  includes  all  of  the  unstable  modes  and  optimal 
combinations  of  a  fixed  number  of  stable  modes  should  involve  both  projections  r  and  n  and  four 
matrix  equations  in  variables  Q,P,Q,  and  P.  When  the  result  is  specialized  to  the  full-order  case 
we  expect  the  two  projections  to  merge  to  form  the  identity  and  the  four  matrix  equations  to  col¬ 
lapse  to  the  single  observer  Riccati  equation.  A  third  projection  v  due  to  singular  measurement 
noise  and  static  estimation  can  also  be  incorporated  (Haddad  and  Bernstein,  1987,  Halevi,  1988). 
This  general  solution  remains  the  subject  of  current  research. 

After  introducing  notation,  we  consider  the  reduced-order  estimation  problem  for  continuous¬ 
time  plants  in  Section  2.  In  Section  3  the  corresponding  discrete-time  problem  is  considered.  For 
stable  plants  the  reduced-order  discrete-time  solution  was  given  in  Bernstein,  Davis,  and  Hyland, 
1986. 

Notation  and  Definitions 
Note:  All  matrices  have  real  entries 

DR.,  IRrX*,  IRr,  IE  real  numbers,  r  x  s  real  matrices,  IRrxl,  expected  value 

In ,  (  )T,  0rX,,  Or  n  x  n  identity  matrix,  transpose,  r  X  a  zero  matrix,  0rXr 

n,l,ne,nu,nt,q  positive  integers 

x,y,xe,*u,x,,ye  n,l,  nt,nu,n„  g-dimensional  vectors 

A,  C  n  x  n,  lx  n  matrices 

Au,  Au#,  At  nu  x  nu,  nu  x  nt,  n,  x  n ,  matrices 

Cu,  C,  lx  nu,  lx  n,  matrices 

L,  Lu,  L,  q  x  n,  q  x  nu,  q  x  n,  matrices 

R  q  x  q  positive-definite  matrix 

At,  Bt ,  Cs,  Dc  n,  x  ne,  nt  x  l,  q  x  ne,  qx  l  matrices 

t,  k  t  €  [0,  oo),  discrete-time  index  1, 2, 3, . . . 
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A 

Wj(') 

Vx 

Va 

V13 

w(-) 


A  - 


L^n.xn, 


B,C 


n,  ^-dimensional  continuous-time  or  discrete-time  white  noise  processes 
n  x  n  nonnegative-definite  intensity  or  covariance  of  iui(-) 

£  x  £  positive-definite  intensity  or  covariance  of  u>2(-) 
n  x  t  cross  intensity  or  cross-covariance  of  twi(-),  to2(-) 


ttfi(-)  - 


Btw  j(-) 


Jn,xn. 

Vi-V12B?{Inm  0B„xn.]- 


L^n.Xn* J 


S.V*  + 


L^n.xn, J 


B.V2Bf[/n<.  0n„ 


Xn. 


2.  Problem  Statement  and  Main  Theorem 


Reduced-Order  State-Estimation  Problem.  Given  the  nth-order  observed  system 


x[t)  =  Ax(t)  +  Wi[t), 

(2.1) 

y(t)  =  Cx(t)  +  w2(t), 

(2.2) 

design  an  neth-order  state  estimator 

xe(t)  =  Aexe[t)  +  Bey{t), 

(2.3) 

y*(0  =  C«xe(t), 

(2.4) 

which  minimizes  the  state-estimation  error  criterion 

J{A„Bt,Ct)  =  Jjim^ IE [Lx{t)  -  ye(t)]T R[Lx(t)  -  y,(t)]. 

(2.5) 

In  this  formulation  the  plant  is  partitioned  into  possibly  unstable  and  stable  subsystems.  Thus, 
letting  x(t )  =  [*J(t),xf  (t)]r  and  iui(t)  =  [«'ftl(f),u/i',(t)]T,  (2.1)  can  be  written  as 


xu(t)' 

Au  AU0 

xu(t)' 

_L 

wlu(t) 

*•(0  j 

A4 

x.(t) 

r 

Wi,(t) 

where  A„  €  IRnuX”“  is  possibly  unstable,  A ,  €  is  asymptotically  stable,  and  the  measure¬ 

ment  equation  (2.2)  becomes 


y(t)  =  [Cu  C.) 


Xu(t) 

.  *•(*)  . 


+  W2(t). 


(2.7) 


Furthermore,  the  matrix  L,  which  is  partitioned  as 


L  —  [Lu  L0\, 


(2.8) 
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identifies  the  states  or  linear  combinations  of  states  whose  estimates  are  desired.  The  dimension  ne 
of  the  estimator  state  xt  is  fixed  to  be  equal  to  the  order  of  the  unstable  part  of  the  system,  i.e., 
n,  =  nu.  Thus,  the  goal  of  the  Reduced-Order  State-Estimation  Problem  is  to  design  an  estimator 
of  order  nu  which  yields  quadratically  optimal  estimates  of  specified  linear  combinations  of  states  of 
the  system.  As  mentioned  in  Section  1,  Au  includes  all  unstable  modes  of  A  as  well  as  an  arbitrary 
number  of  selected  stable  modes  of  A. 

Since  Au  may  contain  unstable  modes,  define  the  error  state  z(t)  =  xu(t)  —  xe(t )  satisfying 


i(i)  =  (Au  -  BtCu)xu(t)  -  Atxe(t)  +  (Au.  -  BeC,)x,(t)  +  wlu(t)  -  Bew2[t).  (2.9) 

Note  that  the  explicit  dependence  of  the  error  states  z(t)  on  the  unstable  states  xu(t)  can  be 
eliminated  by  constraining 

A.  =  A„  -  B.Cu  (2.10) 

so  that  (2.9)  becomes 

i(t)  =  (A„  -  BeCu)z(t )  +  (Au,  -  B,C,)x,(t)  +  u>i„(i)  -  Bew2(t).  (2.11) 

Similarly,  the  explicit  dependence  of  the  estimation  error  (2.5)  on  the  unstable  states  xu(i)  can  be 
eliminated  by  setting 

C,  =  I„.  (2.12) 

Now  (2.9)-(2.11)  yield 

x(t)  =  Ax(t)  +  u>(t),  (213) 

where 

s.(f\  ±  z{t)  2  —  —  Au»  —  BeC , 

w"k(*)J’  [  0n.xn„  A,  J’ 


and  w(t)  and  its  intensity  V  are  given  in  Section  1. 

To  guarantee  that  J  is  finite,  consider  the  set  of  asymptotically  stable  reduced-order  estimators 

5  =  {(A*,  B„Ce)  :  Ae  —  Au  -  BeCu  is  asymptotically  stable} , 

so  that  A  is  asymptotically  stable.  Of  course,  5  is  nonempty  if  (Au,  Cu)  is  detectable.  Furthermore, 
for  nondegeneracy  we  restrict  our  attention  to  the  set  of  admissible  estimators 

S+  =  {(Ae,£e,C,)  €  S  :  (Ae,Ce)  is  observable}, 
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where  A,  and  C,  are  given  by  (2.10)  and  (2.12).  Also,  for  arbitrary  Q  €  IRnXn  define  the  notation 

Qa  =QCT+V13. 


r 

Theorem  2.1.  Suppose  (A„Bt,Ct)  E  S+  solves  the  Reduced-Order  State- Estimation  Prob¬ 
lem  with  constraints  (2.10)  and  (2.12).  Then  there  exist  n  x  n  nonnegative-definite  matrices  Q,P 
|  such  that  Ae,Bt,Ct  are  given  by 


A .  =  *(A  -  QaVflC)FT , 

B.  = 

Ct  =  LFt , 

and  such  that  Q,P  satisfy 

0  =  AQ  +  QAt  +Vx-  QaVfxQl  +  fi±QaVflQ^l, 


where 


0  =  (A  -  nQaVilC)TP  +  P(A  -  nQaVf'C)  +  LTRL, 


P  = 


(2.14) 

(2.15) 

(2.16) 


(2.17) 

(2.18) 

(2.19) 


f  =  [/«.0n.xn.]>  *=[/«„  P^Pue], 


/n.  P.7lPu 


U  *  ti«  l  “  j 

In  0  >  —  I* 

[un,Xn,  un. 


n  =  Fr4>  = 

Furthermore,  the  minimal  cost  is  given  by 

J(At,Bt,Ct)  —  tr  QLtRL. 


(2.20) 


(2.21) 


(2.22) 


Proof.  See  Appendix  A.  □ 

Remark  2.1.  Note  that  since  $FT  —  /n„  the  nxn  matrix  n  which  couples  the  modified  Riccati 
equation  (2.17)  and  the  Lyapunov  equation  (2.18)  is  idempotent,  i.e.,  n2  =  p.  Note  also  that  rank 
fi  =  nu.  This  projection  is  completely  distinct  from  the  projection  r  appearing  in  Bernstein  and 
Hyland,  1985. 


Remark  2.2.  In  the  full-order  case  nu  =  n,  Theorem  2.1  corresponds  to  the  standard  steady- 
state  Kalman  filter  result.  To  see  this,  formally  set  $  =  F  =  n  =  In  and  n±  =  0n  so  that  (2.18)  is 
superfluous  and  (2.17)  specializes  to  the  standard  observer  Riccati  equation. 

* 

Remark  2.3.  Note  that  (2.14)  and  (2.16)  are  merely  restatements  of  (2.10)  and  (2.12).  Fur¬ 
thermore,  (2.15)  implies  that  A  =  A  -  nQ^Y^C  so  that  the  coefficient  of  P  in  (2.18)  is  asymp¬ 
totically  stable. 

3.  Discrete-Time  Formulation 

Discrete-Time  Reduced-Order  State-Estimation  Problem.  Given  the  nth-order  ob¬ 
served  system 

x(k  +  1)  =  Ax(fc)  +  tux(fc),  (3.1) 

y(k)  =  Cx(k)  +  Wi(k),  (3.2) 

design  an  neth-order  state  estimator 

x,(&  + 1)  =  Aext(k)  +  B,y(k),  (3.3) 

y«(*)  =  C,xe(k )  +  Dty(k),  (3.4) 

which  minimizes  the  discrete-time  state-estimation  error  criterion 

J{A',B',Ct,D.)  ±  lim  m[Lx(k)  -  yt(k)]T  R[Lx(k)  -  y.(*)].  (3.5) 

Because  of  the  discrete-time  setting  it  is  now  possible  as  in  Bernstein,  Davis,  and  Hyland,  1986,  to 
permit  a  static  feedthrough  term  Dt  in  the  estimator  design.  The  gain  Dt  represents  a  static  least 
squares  estimator  in  conjunction  with  the  dynamic  estimator  ( At ,  Be,Ce). 

As  in  the  continuous-time  case,  the  plant  is  partitioned  into  stable  and  possibly  unstable 
subsystems  according  to  (2.6).  Furthermore,  an  error  state  z(k)  =  xu(k)  —  xt[k )  is  defined,  Ae  is 
constrained  as  in  (2.10),  and  C,  is  constrained  to  be  Lu  -  DeCu,  Thus,  the  augmented  system 
consisting  of  the  error  states  z(k)  and  the  stable  states  xt(k)  becomes 

x{k  +  1)  =  Ax(k)  +  w(k),  (3.6) 

where  x(k)  =  [xT(fc),zf(fc)]T. 
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To  guarantee  that  J  is  finite  and  to  obtain  closed-form  expressions  for  the  estimator  gains  we 
restrict  our  attention  to  the  sets 

$  =  {( A,,Bt,C, ,  Dt)  :  A,  =  Au  -  BtCu  is  asymptotically  stable}  , 

§+  =  | (A,,  Be,Ca,D,)  E  §  :  (Ae,Ce)  is  observable  j  . 

Also,  for  arbitrary  Q  E  IRnXn  define  the  notation 

Qa  =  AQCt  +  V13,  V3  =  Vt  +  CQCt. 

Theorem  3.1.  Suppose  (A,,Be,Ce,De)  E  S+  solves  the  Discrete-Time  Reduced-Order  State- 
Estimation  Problem.  Then  there  exist  n  x  n  nonnegative-definite  Q,  P  such  that  Ae,Be,Ce,De  are 


given  by 

Ae=${A-QaVflC)FT,  (3.7) 

B. =$Q*V2-\  (3.8) 

C,  =  (L  -  DtC)FT ,  (3.9) 

De  =  LQCTVf\  (3.10) 

and  such  that  Q,  P  satisfy 

Q  =  AQAt  +  Vi  -  QaVf'Q?  +  HxQaVf'QZn  L  (3.11) 

P  =  (A  -  nQaVf'Cf  P{A  -  nQ.Vf'C)  +  {L-  DeC)T  R{L  -  DeC),  (3.12) 

where  F,$,ii,  and  fx±  are  defined  by  (2.19)-(2.21).  Furthermore,  the  minimal  cost  is  given  by 

j(A„  B„C„  Dt)  =  tr  [( LQLt  -  DtV3D?)R\  .  (3.13) 


Proof.  See  Appendix  A.  □ 

Remark  3.1.  If  a  strictly  proper  estimator  is  desired,  then  delete  Dt  in  (3.9),  (3.12),  and 
(3.13). 
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Appendix  A:  Proof  of  Theorems  2.1  and  3.1 


To  analyze  (2.13)  define  the  second-moment  matrix 


(A.1) 


which  satisfies 

Q(t)  =  AQ(t)  +  Q(t)AT  +  V,  t>  0. 
Since  ( A,,B,,C ,)  €  $,  A  is  asymptotically  stable  and 


(A.2) 


Q  =  lim  E[z(t)zT(t)l 

t — *oo 


exists  and  satisfies 


0  =  AQ  +  QAt  +  V. 


Next  note  that  (2.5)  can  be  written  as 


(A.3) 


J(At,B,,Ct)  =  tr  QLtRL. 


(A.4) 


To  minimize  (A.4)  over  the  open  set  S+  subject  to  the  constraint  (A.3),  form  the  Lagrangian 


C{A',Bt,Ct,Q,P,\)  =  tr[A  QLTRL  +  {AQ  +  QAT  +  V)P], 


(A.5) 


where  the  Lagrange  multipliers  A  >  0  and  P  €  IRnXn  are  not  both  zero.  Setting  dC/dQ  =  0,  A  =  0 
implies  P  =  0  since  A  is  asymptotically  stable.  Hence,  without  loss  of  generality  set  A  =  1. 


Now  partition  n  x  n  P  into  n„  x  nu,  nu  x  n#,  and  n,  x  n,  subblocks  as 


P»  P« 

PL  p. 


p  =  I  ■*  U  A  u« 

I  i 

u« 


Thus  the  stationarity  conditions  are  given  by 


=  ATP  +  PA  +  LtRL  =  0, 
dQ 

jj-  =  PuBtV2  -  [Pu  Pu,]{QCt  +  V12)  =  0. 


Expanding  the  nu  x  nu  subblock  of  (A.7)  yields 


(A.6) 


(A.7) 

(A.8) 


0  =  (Au  —  B,CU)TPU  +  PU(AU  —  BtCu)  +  L^RLU, 


(A.9) 
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which,  using  (2.10)  and  (2.12),  is  equivalent  to 

0  =  Aj  Pu  +  Pu  A,  +  Cj  RCt .  (A.  10) 

Thus,  since  ( A„  Bt,Ct)  6  S  + ,  (A„C,)  is  observable  and  it  follows  from  (A.10)  that  Pu  is  positive 
definite.  Since  Pu  is  thus  invertible,  define  the  nu  x  n  matrices 

F  4  [/„.  0n<.Xn.],  *  4  [Jn„  PZxPu.l  (A.ll) 

and  the  n  x  n  matrix  n  4  Fr$.  Note  that  since  <PFT  =  fi  is  idempotent,  i.e.,  fx2  =  fx. 

Next  note  that  (A.8)  and  (A.ll)  imply  (2.15).  Similarly,  (2.14)  is  equivalent  to  (2.10)  with  Be 
given  by  (2.15).  Finally,  (2.16)  is  a  restatement  of  (2.12).  Now,  using  the  expression  for  Bt,  A  and 
V  become 

A  =  A-fxQaVf1C,  (A.12) 

V  =  Vl-  tVf'Qlf  -  pQaVf'V?,  +  nQaV2~'Qlf.  (A.  13) 

Finally,  (2.17)  and  (2.18)  follow  from  (A.3)  and  (A.7)  using  (A.12)  and  (A.13). 

For  the  discrete-time  problem  define  the  second-moment  matrix 

Q(k)  4  E[x(*)*r(fc)], 

which  satisfies 

Q(k  +  1)  =  AQ(k)AT  +  V.  (A.14) 

Since  A  is  asymptotically  stable, 

Q  =  lim  IE[x(&)xT(&)] 

fc-^OO 

exists  and  satisfies 

Q  =  AQAt  +  V.  (A. 15) 

The  remainder  of  the  proof  follows  as  above  for  the  continuous-time  case. 

Acknowledgment.  We  wish  to  thank  David  C.  Hyland  for  several  helpful  suggestions. 
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The  optimal  projection  equations  derived  previously  for  reduced-order,  continuous-time  modeling,  estimation, 
and  control  are  developed  for  the  discrete-time  case.  The  design  equations  are  presented  in  a  concise,  unified 
manner  to  facilitate  their  accessibility  for  the  development  of  numerical  algorithms  for  practical  applications.  As  in 
the  continuous- time  case,  the  standard  Kalman  filter  and  linear-quadratic-Gaussian  results  are  immediately 
obtained  as  special  cases  of  the  estimation  and  control  results. 


Nomenclature 


A.  B,C 

A.,'Bm.C„ 

A„B„C',Dr 

A,.B,.Ct.Dt 

E, 

E 

1, 

k 

L 

n,  m,  t, 

R,  S’,  R, 

R, 

R,: 

R,RXi 

R 

n  Z 

v, 

V 

K 

V , 

H  ,  I*,  .  H, 

X,  X,.  X, 


ZT 

n.('J') 

f>(Z) 


»  n  x  n,  n  x  m,  fx  n  matrices 

—  nm  y  nm,  nmX  m,  tx  nm  matrices 

■  ntX  n,,  n,  X  t,  p  X  nt,  p  x  t  matrices 

—  nt  X  nc ,  ncy.  { ,  m  X  nc,  m  X  (  matrices 

—  matrix  with  unity  in  the  (i,  i)  position 
and  zeros  elsewhere 

—  expected  value 

—  r  X  r  identity  matrix 

—  discrete- time  index  1, 2, 3, . . . 

—  p  X  n  matrix 

—  positive  integers,  1  js  nm,  nr,  nc  s  n 

—  f'x  { ,  p  x p,  m  x  m  positive-definite  matrices 

—  n  X  n  nonnegative-definite  matrix 

—  n  X  m  matrix  such  that  /?,  -  RuRl'R'u 
is  nonnegative  definite 

—  real  numbers,  rxj  real  matrices 

R|  Ru 

“k  r2. 

—  trace  of  square  matrix  Z 

m  m-,  p-dimensional  vectors 

«■  m  x  m  positive-definite  covariance  of  w 

—  n  x  n  nonnegative-definite  covariance  of  h-, 

—  f  x  (  positive-definite  covariance  of  w2 

—  n  x  f  cross-covariance  of  »•, .  w- 

—  m-,  n-,  t'-dimensional  zero-mean  discrete-time 
white  noise  processes 

—  n-,  nm-,  n, -dimensional  vectors 

—  (i,  j)  element  of  matrix  Z 

—  transpose  of  vector  or  matrix  Z 
-(Zr)-*or(Z-')r 

—  ♦£,' ’  (unit-rank  eigenprojection47) 

—  rank  of  matrix  Z 
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I.  Introduction 

IN  a  recent  series  of  papers1'11  it  has  been  shown  that  the 
first-order  necessary  conditions  for  quadratically  optimal, 
continuous-time,  reduced-order  modeling,  estimation,  and 
control  can  be  transformed  into  coupled  systems  of  two,  three, 
and  four  matrix  equations,  respectively.  This  coupling,  due  to 
the  presence  of  an  oblique  projection  (idempotent  matrix), 
arises  as  a  rigorous  consequence  of  optimality,  hence  suggest¬ 
ing  the  name  optima!  projection.  For  the  estimation  and 
control  problems,  this  formulation  provides  a  direct  generali¬ 
zation  of  classical  steady-state  Kalman  filter  and  linear- 
quadratic-Gaussian  (LQG)  control  theory.  In  the  full-order 
case  the  projection  becomes  the  identity  matrix,  the  additional 
two  modified  Lyapunov  equations  drop  out.  and  the  remain¬ 
ing  modified  Riccati  equations  become  the  usual  Riccati  equa¬ 
tions. 


Coupling  via  the  optimal  projection  supports  the  view  that 
sequential  reduced-order  design  procedures  consisting  of  either 
1)  model  reduction  followed  by  estimator  (controller)  design 
or  2)  estimator  (controller)  design  followed  by  estimator  (con¬ 
troller)  reduction  are  generally  not  optimal.  Furthermore,  for 
the  control  problem  the  coupled  structure  of  the  equations 
yields  the  further  insight  that  in  the  reduced-order  case  there 
is  no  longer  separation  between  the  operations  of  state  estima¬ 
tion  and  state-estimate  feedback,  i.e..  the  certainty  equivalence 
principle  breaks  down. 

For  practical  applications,  the  optimal  projection  equations 
permit  the  development  of  alternative  numerical  algorithms 
that  operate  through  successive  iteration  of  the  optimal  pro¬ 
jection4*  rather  than  by  gradient  search  techniques.12  By 
recognizing  that  each  local  extremalcorresponds  to  n,  possible 
choices  out  of  n  rank-1  eigenprojections  of  the  product  of  a 
pair  of  pseudogramians.  it  is  possible  to  efficiently  identify  the 
global  minimum.10  This  idea  is  philosophically  similar  to 
Skelton’s  component-cost  analysis.  15 

The  purpose  of  the  present  paper  is  to  develop  the  optimal 
projection  equations  for  reduced-order  modeling,  estimation, 
and  control  in  the  discrete-time  case.  Since  the  underlying 
theory  has  been  discussed  previously,1'11  the  presentation 
herein  is  geared  toward  a  clear  and  concise  statement  of  the 
main  results  to  facilitate  numerical  developments  and  practi¬ 
cal  application  For  example,  by  expressing  the  optimal  pro¬ 
jection  in  terms  of  eigenprojections,  a  variety  of  novel  al¬ 
gorithms  are  immediately  suggested.  For  illustrative  purposes 
we  apply  the  results  on  reduced-order  state  estimation  to  a 
third-order  problem  to  obtain  reduced-order  estimators  and 
the  results  on  reduced-order  dynamic  compensation  to  a 
tenth-order  problem  to  obtain  reduced-order  controllers. 
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Because  of  the  discrete-time  setting  it  is  now  possible  to 
permit  static  feedthrough  gains  in  the  estimator  and  controller 
designs.  As  previously  noted,7  nonsingular  control  weighting 
and  measurement  noise  in  the  continuous-time  case  permit 
only  a  purely  dynamic  (strictly  proper)  controller.  Note  that 
this  is  precisely  the  case  in  continuous-time  LQG  theory, 
which  always  yields  a  strictly  proper  feedback  controller.  The 
static  gains  in  the  discrete-time  estimator  problem  permit 
simultaneous,  unified  treatment  of  nondynamic  least-squares 
estimation  along  with  dynamic  (Kalman  filter-type)  estima¬ 
tion. 

The  references  include  a  representative  sampling  of  papers 
on  quadratically  optimal  reduced-order  modeling,17'25  estima- 
tion,5555  and  control, 54-44  along  with  closely  related  ap¬ 
proaches.  For  emphasis  on  the  discrete-time  problem,  see 
Refs.  18.  30,  41.  42,  44,  and  45. 

11.  Problem  Statement  and  Main  Results 

We  now  state  the  reduced-order  modeling,  estimation,  and 
control  problems  The  object  of  the  model-reduction  problem 
is  to  determine  a  model  of  reduced  state-space  dimension 
whose  steady-state  response  to  white  noise  inputs  (or,  equiv¬ 
alently,  impulse  response)  best  approximates,  in  a  quadratic 
(least-squares)  sense,  the  response  of  a  given  high-order  sys¬ 
tem.  In  the  reduction  process  the  order  of  the  reduced  model 
is  fixed  and  the  optimization  is  performed  over  the  .uodel 
parameters. 


For  the  fixed-order  dynamic-compensation  problem,  a  static 
feedthrough  term  is  included,  i.e.,  the  controller  may  be  non- 


strictly  proper. 

Reduced-Older  Dynamic-Compensation  Problem 
Given  the  controlled  system 

x(*  +  l)-dx(*)  +  M*)  +  w,(*)  O'*) 

y(k)-Cx{k)  +  w2(k)  (12) 

design  a  reduced-order  dynamic  compensator 

x1(k+\)-Alx,(k)  +  B,y(k)  (13) 

u(k)  -C.x.(k)  +  Dty(k)  (14) 

which  minimizes  the  dynamic-compensation  criterion 
y,(A,.B,,Ct,D,)-^lim  £[x(k)rR,x(k) 

+  2x(k)TRi:u(k)  +  u(L)rR2u(*)]  (15) 


To  guarantee  that  Jm,  Jr,  and  /,  are  finite  and  independent 
of  initial  conditions,  consideration^  is  restricted  to  the  follow¬ 
ing  (open)  sets.  [A  triple  (,4,ff,  C)  is  min  rial  if  (/!,£)  is 
controllable  and  (A.C)  is  observable  ] 


Reduced-Order  Modeling  Problem 
Given  the  model 

x(k  +  1)  -Ax(k)  -h  Bw(k) 

y(k) m  Cx( k ) 

design  a  rede  ed-order  model 


(1)  A„,  is  stable  and  ( A„ .  Bm  ,  C„)  is  minimal} 

(2)  yf^{(Ar.Br.Cr.Dr): 

At  is  stable  and  (  Ar,  Br,Cr)  is  minimal} 


+  1) -*n,xm(k)  +  B„w(k)  (3) 

yJk)-Cmx(k)  (4) 

which  minimizes  the  model-reduction  criterion 

JjAm.Bnl.C„) 

A  Urn  £[>„,(*) -y(k)]  R[ym{k)-y(k)}  (5) 


3^  -  (  A,  ,  fl,  ,  c; .  D,  ) : 


A  +  BD,C  BCc 
BC  Ac 


is  stable  and  ( A,  ,  Bc .  C, )  is  minimal 


Let  nr  genetically  denote  nm,  nt,  and  nt.  The  following 
factorization  lemma  will  be  needed  for  the  main  results 
Lemma  2.1  Let  re  R”'“'  Then 


The  goal  of  the  reduced-order  state-estimation  problem  is  to 
design  an  estimator  of  given  order  which  yields  quadratically 

1 

T*  —  T 

(16) 

optimal  (least  squares)  estimates  of  specified  linear  combina¬ 
tions  Lx  of  states  x  In  pracuce,  the  order  of  the  estimator 
may  be  determined  by  implementation  constraints,  such  as 
real-time  computing  capability.  Note  that  the  feedthrough 

p(t)  “  ", 

if,  and  only  if,  there  exist  G,  T  e  such  that 

(17) 

term  D,  permits  the  utilization  of  a  static  least-squares  esti¬ 
mator  in  conjunction  with  the  dynamic  estimator  (Ar,  B,,C,V 

Grr-r 

(18) 

Reduceel-Orter  Stale- Estimation  Problem 

rcr  -  f„ 

(19) 

Given  the  observed  system 

x(  k  +  1)  **  Ax(  k)  +  w,(  k)  (6) 

r(*)-Cx(A)  +  w,(*)  (7) 

design  a  reduced-order  state  estimator 

x,{k-H)-Arx,{k)  +  *,>(*)  (8) 

>,(*)  “  Cfx,{k)  +  D,y(k)  (9) 

which  minimizes  the  state-estimation  criterion 
J,(  A,  B,.C,,Dr) 

A  Um  £[  y,(k)  -  Lx(k)]TV[  y,(*)  -  Lx(k)}  (10) 


Furthermore,  G  an.  '  are  unique  to  a  change  of  basis  in  /?”■ 
Proof  Sufficiency  .s  obvious  To  prove  necessity,  first  note 
that  due  to  Eq  (16;  the  eigenvalues  of  r  are  either  0  or  1 
Further,  it  is  easy  to  see  that  t  has  a  diagonal  Iordan 
canonical  form  Hence,  the  result  follows  from 


r-  S 


0 


cTr 


where  G-[*r  OISM-I*1  0]S' ',  and  ♦  €  ■ 

For  convenience,  call  G  and  T  satisfying  Eqs  (18)  and  (19) 
a  projective  factorization  of  t.  Furthermore,  for  n  X  n  non- 
negative-definite  matrices  (i.e.,  symmetric  matrices  with  non¬ 
negative  eigenvalues)  3  and  9 .  define  the  set  of  contragredi- 
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truly  diagor  adzing  transformations 

9(£,&) 

A  {*  ejr*":  *-'J*-Tand  are  diagonal) 

It  follows  from  Ref.  48,  p.  123,  Theorem  6.2.5,  that 
is  always  nonempty.  This  set  does  not,  however,  have  a  unique 
element  since  basis  rearrangements  and  sign  transpositions 
may  be  incorporated  into  'F.  Further  nonuniqueness  arises  if 
2£P  has  repeated  eigenvalues. 

Theorem  2.1.  Suppose  A  is  stable  and  (Am,  B„,  Cm)eym 
solves  the  reduced-order  modeling  problem.  Then  there  exist 
n  x  n  nonnegative-definite  matrices  Q  and  P  such  that  Am, 
Bm ,  and  C„,  are  given  by 


Am  -  TACt 

(20) 

Bm-TB 

(21) 

cm  -  cgt 

(22) 

and  such  that  Q  and  P  satisfy 

Q  “  AtQttAt  +  BVBt 

(23) 

P  -  A'r’PrA  +  CtRC 

(24) 

where 

*AIn,(*) 

i-1 

(25) 

tor  some  *e9(Q,P)  such  that  (ir~lQP' 1r)^t)  +  Q,  i- 
1  and  some  projective  factorization  G,r  of  r.  Fur¬ 

thermore,  the  minimal  cost  is  given  by 

•U  Am,Bm,  Cm)  -  tr[(  W ■  -  tQtt)CtRC]  (26) 

where  H[  is  the  unique  (nonnegative-definite)  solution  of 


W,  ~AWcAt  +  BVBt 

For  convenience  in  stating  the  estimator  result,  define  the 
notation 


2q±(AQCt+  Vt  1)V{'(AQCr+  VU)T 
D,C)TN(L-  D.C) 
aqla-{aqct+  yx2)iq-lc 
v2  *■  v2  +  cqct 

Theorem  2.2.  Suppose  A  is  stable  and  (A,,  Br,Cr,  D,)  G 
solves  the  reduced-order  state-estimation  problem.  Then  there 
exist  n  x  n  nonnegative-definite  matrices  Q,  Q,  and  P  such 
that  A,.  Br,  C,,  and  D,  are  given  by 


a,-t[a  ~(aqct+  yx2)i7lc]cT 

(27) 

b,-t(aqct+  Fu)f7> 

(28) 

C,-(L-D,C)Gt 

(29) 

d,~lqctv^1 

(30) 

and  such  that  Q,  Q,  and  P  satisfy 

q-aqat-(aqct+  v„)k'(aqct+  yl2)r 


+  K  +  t±  fcl 

(31) 

Q-AtQttAt+2c 

(32) 

P  —  AqT^tAq  +  2P 

(33) 

where 

r-ln,(*) 

i-l 

(34) 

for  some  *6  S(Q,P)  such  that  (*'lg/ty)„ *  0,  /- 
1. . .  - ,  nt%  and  some  projective  factorization  CS  of  t.  Further¬ 
more,  the  minimal  cost  is  given  by 

U  At,BtX"  D.)  -  tr  [{LQLT  -  D,y2Dj)N]  (35) 


For  the  control  result,  define  the  additional  notation 


A  (  A  QCT  +  vn  +  **>& )  K '  ( A  QCT  +  yl2  +  BDCV2 ) r 
*  (  BrPA  +  R[2  +  R2DcC)TR-2l(BrPA  +  Rfr  +  R2DcC) 
AfAA-BR2l(BTPA  +  R(2) 


R2±R2  +  BrPB 


K 

-R2l(  BtPA  +  Hjj) 


Theorem  2.3.  Suppose  (Ac,  Br,  Cr,  Dc)  £5?  solves  the  re¬ 
duced-order  dynamic-compensation  problem.  Then  there  exist 
n  x  n  nonnegative-definite  matrices  Q,  P,  Q,  and  P  such  that 
At ,  Br,  Cr.  and  Dc  are  given  by 

A<-r[A-(AQCr+  yl2)tr‘c 

-  BR2'(  BtPA  +  R*2)  -  BDcc\  Gt  (36) 

«r[(dGCr+K1J)FJ-l  +  B/><]  (37) 

c.  «-( *V( btpa  +  *[,)  +  d,c}gt  ( 

D,  —  ~R2l(  BtPAQCt  +  R(2QCt  +  BTPyl2)y2-  >  (39) 
and  such  that  Q.  P,  Q.  and  P  satisfy 


q~aqat-{aqct+  yx2)>7'{AQcr+  yl2)T 


+  yt+  r.  Qrl  (40) 

P-ArPA  ~{BtPA  +  R[J)rRj-’(Br/>d  +  Rj2) 

+  R,+t[>t1  (41) 

Q-A.t(?ttAt,  +  2’q  (42) 

P  -  A^PiAq  +  2'P  (43) 

where 

rA^n.t*)  (44) 

i-l 


for  some  +  £S(Q,  P)  such  that  (+‘ „  w 0,  i- 
1 ....  n, ,  and  some  projective  factorization  C,  T  of  r.  Further- 
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more,  the  minimal  cost  is  given  by 

/  (  A, .  B, .  C, .  D,  )  -  tr[(  MQMt  +  MtQttMt)  fl]  (45) 

Remark  2.1.  To  specialize  the  estimation  and  control  results 
to  the  strictly  proper  (no-feedthrough)  case,  merely  ignore 
Eqs.  (30)  and  (39)  and  set  £>,  —  0  and  £)  —  0  wherever  they 
appear. 

Remark  2.2.  In  the  full-order  cases  nr  —  n  and  n.  —  n  in 
Theorems  2.2  and  2.3,  the  projection  r  becomes  the  identity 
and  Eqs.  (32),  (33),  (42),  and  (43)  play  no  role.  In  this  case  G 
and  T  are  also  the  identity.  Specializing  further  to  the  purely 
dynamic  case  D  =  0,  D,  —  0  as  in  the  previous  remark  yields 
the  standard  Kalman  filter  and  LQG  results. 

Remark  2.3.  As  previously  noted.7 10  11  the  indeterminacy  in 
specifying  the  projective  factorization  G.  T  satisfying  Eqs.  (18) 
and  (19)  corresponds  to  nothing  more  than  an  arbitrary  choice 
of  internal  state-space  basis  for  the  design  systems 
(4„1.fl„.CJ,(/(,.,fi  C,),and(/(,J1.f,). 

Remark  2.4.  Since  @_an_d  P  are  balanced  by  means  of  the 
transformation  Q(Q,  P),  it  follows  that  'i~lQP' V  is  di¬ 
agonal.  Hence,  QP  is  semisimple  and  thus  n,('k)  is  a  rank-1 
eigenprojection  of  QP.  (A  semisimple  matrix  possesses  a 
diagonal  Jordan  form.47,411)  Although  the  optimal  projection  r 
is  characterized  in  Eqs.  (25).  (34).  and  (44)  as  the  sum  of 
rank-Wigenprojections  of  QP.  because  of  the  nonuniqueness 
in  Q(Q.  P).  the  theorems  do  not  specify  which  eigenprojec- 
tions  actually  comprise  r.  From  analytical  examples10  it  can 

be  seen  that  each  of  the  (  ”  j  possible  projections  may  corre¬ 
spond  to  a  local  extremal  in  the  optimizauon  problem. 

Remark  2.5.  The  proofs  of  Theorems  2. 1-2.3  are  similar  to 
the  continuous-time  results  and,  hence,  have  been  omitted.  To 
help  the  reader  reconstruct  the  lengthy  manipulations,  the  key 
details  differing  from  the  continuous-time  case  are  pointed 
out  For  the  control  problem,  an  ( n  +  nt )  X  (n  +  n(  )  discrete¬ 
time  algebraic  Lyapunov  equation  is  obtained  for  the  steady- 
state  covariance  of  the  closed-loop  system.  Regarding  this 
equation  as  a  side  constraint,  the  Lagrange  multiplier  tech¬ 
nique  is  used  to  compute  stationarity  conditions  that  yield 
explicit  expressions  for  A ,,  B, .  C. .  and  D,  The  piojection 
arises  when  these  expressions  are  substituted  into  the  original 
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augmented  Lyapunov  equation  and  its  dual.  The  interesting 
aspect  is  that  the  explicit  gain  expressions  and  the  definition 
of  the  optima]  projection  arise  in  the  reverse  order  as  com¬ 
pared  to  the  continuous  time  derivation.  Similar  remarks  apply 
to  the  reduced-order  modeling  and  estimation  problems. 

III.  Examples 

As  an  application  of  Theorem  2.2  on  reduced-order  state 
estimation,  the  stirred-tank  example  from  Ref.  36,  pp.  107. 
473,  and  531,  is  considered.  Ignoring  the  undisturbed  volume 
state,  the  remaining  states  are  the  incremental  tank  concentra¬ 
tion  and  variations  in  the  feed  concentrations.  The  problem 
data  are  as  follows: 


A 


0.9048  0.06702  0.02262 

0  0.8825  0 

.0  0  0.9048 


C-[I  0  0],  F2  =  I0"6,  Ei2-0,  A'=L«J3 


•V 


5.399  X  10"6 
8.015  X  10"s 
LS  762  x  10" 5 


8.015x10  5 
2.212  x  10  ' 
0 


8.762  x  10" 5 
0 

7.251  X  10" 5 


The  standard  Kalman  filter  result  is 


-0.7959  0.06702  0  2262 

-8.205  0.8825  0 

- 10.29  0  0.9048 


B. 


1.701 

8.205 

10.29 


C, 


/„  Dr~  0 


with  performance  Jc  —  0.0358515. 

Permitting  nonzero  feedthrough  £>,.  yields 


009885 

0.1061 

-0.0167 

- 13.34 

-0.6851 
.  0.1503 

0  02176 
0.2652 

0.09015 

0.8707 

•  B,- 

-  10.08 
.  2.237 

Cr 


-0.006261 

0.5716 

0.6822 


-0.007282  0.0007445 

-0  0002166  0.007202 
-0.006021  -0.005440 


Dr 


0.9068 
9.298 
11  37 


where  the  (improved)  performance  is  J,  =  0.032401049 

For  the  reduced-order  results,  an  algorithm  for  solving  all 
three  equations  (31-33)  is  described  briefly.  Begin  by  setting 
r  —  /„  and  solving  Eqs.  (31-33)  for  the  “full-order"  values  of 
Q.  Q.  and  P  Choose  nr  eigenprojections  of  QP  in  diagonal¬ 
izing  coordinates  and  iterate  the  modified  Lyapunov  equations 
(32)  and  (33)  until  convergence  of  r,  Q,  and  P  is  obtained. 
Return  to  Eq.  (31)  and  solve  for  Q  with  F,  +  rA  Qt l  as  the 
new  nonhomogeneous  term  in  the  Riccati  equation.  Repeat 
the  above  steps  until  convergence  is  reached. 

In  applying  this  algorithm  to  the  present  example,  the 
eigenprojections  were  chosen  for  convenience  in  accordance 
with  the  largest  eigenvalues  of  QP.  The  results  indicate  attain¬ 
ment  of  the  global  minimum  For  the  optimal  second-order 
filter,  the  gains  are  given  by 


A  - 

0.09898  - 

0  1137  1  B 

-I~13  33  1 

r 

0.6632 

0  02285 J’  • 

L  9.762  J 

'  -0.006259 

0.007796 

0.9068' 

C- 

0.5716 

-0.0002737 

9.298 

.  0.6823 

0  006121  . 

.11.37  . 
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with  J,  —  0.032401094,  and,  for  the  first-order  filter, 
Ar  —  0.1498,  B,-  -14.82 


C  - 


'  -  0.001661 ' 

‘  0.9749' 

0.5748 

9.489 

.  0.6897  . 

.11.65  . 

with  J,  ~  0.03240418.  Convergence  to  this  accuracy  was  ob¬ 
tained  with  7  iterations  of  Eqs.  (31-33)  for  the  second-order 
filter  and  10  iterations  for  the  first-order  filter.  Note  that  the 
performance  degrades  only  slightly  with  reduced  order,  and 
the  static  gain  term  gives  the  first-order  filter  better  perfor¬ 
mance  than  the  standard  (full-order)  Kalman  filter. 

To  illustrate  Theorem  2.3  for  designing  reduced-order  dy¬ 
namic  compensators,  consider  a  simply  supported  beam  with 
two  colocated  sensor/actuator  pairs.  Assuming  the  beam  has 
length  2  and  that  the  sensor/actuator  pairs  are  placed  at 
coordinates  a  —  55/172  and  b  -  46/43,  a  continuous-time 
model  of  the  following  form  is  obtained: 


x  —  Ax  +  Bu  +  w,  y  —  Cx  +  w2 
where,  retaining  the  first  five  modes, 

0 


A  —  block 


-diag| 


0 

-<*>1 


1 

-2fw, 


1 

-2fus 


1) 


<•>. 


i-l . 5,  f-  0.005 

-0.5(1  +  (  -  I)')sin(iir6/2),  i-l . 10 


-  0.5(l  +  (  -  l)’)sin(iir«/2),  i-l,.. .,10 
C-BT 

The  intensities  P",  and  V}  of  w,  and  w2  are  chosen  to  be 


k'.-O.lAo,  K-OOl/j 


and  it  is  assumed  that  w,  and  w2  are  uncorrelated.  For  the 
continuous- time  cost 


set 


7—  lim  £■[ +  2jcrR1jU  +  u^Rju] 

f-*oo 

-  block -diag( [ q  . [j  jj) 


R,2  —  0,  R-,  —  /, 


To  convert  to  the  discrete-time  problem  with  discretization 
interval  h,  let34, 49 


-4-e4*,  fl-Z’V'fidi,  C-C 


Vx  -  (V'K.e^'d/,  V2  -  V, 
Jo 

R,  —  Ru  R|j  —  0,  Rj  —  R2 


The  design  equations  (40-43)  for  the  control  problem  can  be 
solved  using  exactly  the  same  techniques  as  in  the  previous 
example  for  the  estimation  problem.  For  the  strictly  proper 
case  ( Dr  -  0),  a  series  of  controllers  was  designed  with  «f  - 
1.2, .  ,10.  where  the  nr  -  10  result  is  the  LQG  solution.  The 


gains  for  the  case  n,  -  4,  for  example,  are  given  by 


A.  - 


0.9317 

0.1572  - 

0.2130  - 

0.005038 

0.0137 

0.6879 

0.2519 

0.4085 

0.3330 

-0.0580 

0.7713  - 

0.2602 

0.05980 

-0.3297 

0.3918 

0.3005  . 

-0.4920 

-0.2166  ' 

0.6179 

-0.5959 

0.2253 

-0.02572 

0.07221 

-0.4863  . 

0.05864 

-0.3094 

-0.01815 

0.2409 

-0.1301 

0.1463 

-0.1945 

-0.07192 

Figure  1  summarizes  the  results  for  each  order,  where  the 
rms  controller  performance  is  given  by 


J ; 


lim  x(  k)T Rtx(  k) 

K  -•  3C 


These  rest  1  is  provide  a  tradeoff  study  of  performance  versus 
controller  jrder  that  can  be  used  to  assess  processor  require¬ 
ments. 


IV.  Conclusion 

Optimality  conditions  have  been  obtained  for  the  problems 
of  least-squares,  reduced-order  (i.e.,  fixed-order),  discrete-time 
modeling,  estimation,  and  control.  These  conditions  comprise 
systems  of  two.  three,  and  four  matrix  equations,  respectively, 
coupled  by  an  oblique  projection  which  determines  the  opti¬ 
mal  system  gains.  When  the  order  of  the  estimator  or  con¬ 
troller  is  equal  to  the  order  of  the  plant,  the  oblique  projection 
becomes  the  identity  matrix  and  the  estimation  and  control 
results  specialize  to  the  standard  discrete-time  Kalman  filter 
and  linear-quadratic-Gaussian  results.  The  design  results  are 
applied  to  two  illustrative  examples.  For  a  third-order  stirred- 
tank  problem,  filters  of  first  and  second  order  are  obtained, 
and.  for  a  simply  supported  Euler  beam  example  with  five 
flexible  modes  (i.e.,  10  states),  a  series  of  reduced-order  con¬ 
trollers  with  1,  2 . 9  poles  is  obtained.  The  latter  results 

illustrate  the  tradeoff  between  control-system  performance 
and  controller  order 
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The  Optimal  Projection  Equations  for  Fixed-Order 
Sampled-Data  Dynamic  Compensation  with 
Computation  Delay 

DENNIS  S.  BERNSTEIN.  LAWRENCE  D.  DAVIS,  AND 
SCOTT  W.  GREELEY 

Abstract — Far  an  LQG-lyp*  sampled -data  regulator  problem  which 
accounts  for  computational  delay  and  utilizes  an  averaging  A/D  device, 
the  equivalent  discrete-lime  problem  is  shown  to  be  of  increased  order  due 
to  the  inclusion  of  delayed  measurement  states.  The  optimal  projection 
equations  for  reduced-order,  discrete-lime  compensation  are  applied  to 
the  augmented  problem  to  characterize  low-order  controllers.  The  design 
results  are  illustrated  on  a  tenth-order  flexible  beam  example. 

1.  Introduction 

Classical  sampled-daia  control  theory  has  been  extensively  developed 
[l]-(7]  and  is  widely  used  in  practical  applications.  Sampled-data  design 
based  upon  modern  optimal  control  theory  has  also  been  developed, 
although  to  a  considerably  lesser  extent  (8]-(  14] .  The  goals  of  the  present 
note  are  twofold.  First,  for  an  LQG-type  sampled-data  regulator  problem 
which  explicitly  accounts  for  computational  delay,  we  obtain  an  equiva¬ 
lent  discrete-time  problem  (Theorem  2.1  and  Corollary  2.1).  The  timing 
diagram  in  Fig.  1  illustrates  the  unavoidable  delay  in  the  feedback  loop 
(see  Section  II  for  notation). '  A  salient  feature  of  this  problem  is  that 
rather  than  replace  the  continuous-time  white  noise  measurement  model 
by  a  discrete-time  version  (which  is  often  done  in  the  literature  since 
continuous-time  white  noise  cannot  be  sampled),  we  employ  an  averag¬ 
ing-type  A/D  device  as  in  [8,  p.  82]  Isee  (2.5)]. 

The  second  goal  of  the  note  is  to  present  a  novel  design  procedure 
which  is  applicable  to  the  equivalent  discrete-time  problem,  and  which 
thus  directly  accounts  for  the  delay  effects.  Since  the  discrete-time  model 
is  of  augmented  order  n  +  /  (n  =  number  of  plant  states,  /  =  number  of 
measurements),  it  seems  natural  to  seek  dynamic  feedback  of  reduced 
order.  To  this  end.  we  apply  the  optimal  projection  equations  for  discrete¬ 
time  dynamic  compensation  to  the  equivalent  discrete-time  problem  to 
characterize  optimal  controllers  of  order  nr  s  n  +  /.  These  equations, 
which  were  previously  derived  in  (17)  for  the  continuous-time  case,  are 
discussed  in  [15],  ]I6|  Note  that,  in  practice,  the  computational  delay 
(and.  hence,  sample  interval)  in  real-time  controller  implementation 
depends  directly  upon  the  controller  order  nc.  For  example,  by  reducing 
nc  the  sample  rate  can  effectively  be  increased.  Thus,  the  engineering 
tradeoffs  of  performance  versus  controller  order  and  sample  interval  can 
be  investigated  using  the  results  of  this  note. 

This  note  also  includes  formulas  for  integrals  of  matrix  exponentials 
arising  in  the  sampled-data/discrete-time  conversion,  along  with  an 
algorithm  for  solving  the  optimal  projection  equations.  The  results  are 
applied  to  a  tenth-order  flexible  beam  example. 

II  Sampled-Data  Problem  and  Equivalent  Discrete-Time 
Formulation 

The  following  notation  and  definitions  will  be  used  throughout 

0, ,,,  0,  r  x  r  identity  matrix,  r  x  s  zero  matrix,  0,,, 

Z,.  ,,  (i,  j )  element  of  matrix  Z 

Manuscript  received  October  4.  1985,  revived  May  17.  1986.  This  work  was  supported 
in  pan  by  the  Air  Force  Office  of  Scientific  Research  under  Contracts  AFOSR  F49620- 
84 -C *0015,  F49620-K6-C -0002 .  and  F49620-86-C-003K 

The  authors  arc  wuh  the  Controls  Analysis  and  Synthesis  Group,  Government 
Aerospace  Systems  Division,  Hams  Corporation.  Melbourne.  FI.  32902 

IEEE  Log  Number  8609872 

'For  simplicity  the  timing  diagram  Fig  I  applies  io  the  case  in  which  the 
compensator  is  strictly  proper  In  the  note  the  results  are  slated  for  the  more  genera]  case 
in  which  a  direct  (static)  feedthrough  term  DJ(k)  is  included 


n-'w  •»  is.  ip. 


Fig.  1.  Timing  diagram  for  sampled-data  controller. 

ZT,  Z  T  transpose  of  vector  or  matrix  Z,  (Zr)~‘ 

E,  matrix  with  unity  in  the  (/,  i)  position  and  zeros 

elsewhere 

£,  R,  R'*‘  expected  value,  real  numbers,  r  x  s  real  matrices 

stable  matrix  matrix  with  eigenvalues  in  open  unit  disk 

nonnegative-  diagonalizable  matrix  with  nonnegative  eigenvalues 
semisimple  [18],  [19] 
matrix 

n,  m,  I,  nc  positive  integers,  1  s  nc  s  n  +  / 

x,  v,  y,  xc  n,  m,  /,  nc- -dimensional  vectors 

A,  B,  C  n  x  n,  n  x  m.  /  x  n  matrices 

Ac.  Be  Cc,  Dc  nc  x  rtc,  nc  x  /,  m  x  nc,  m  x  /  matrices 
Wi,  w2  n,  /-dimensional  zero-mean  continuous-time  white 

noise  processes 

y,  n  x  n  nonnegative-definite  intensity  of  w, 

F;  l  x  l  positive-definite  intensity  of  w2 

V, j  n  x  /  cross  intensity  of  w,,  w2 

R,  n  x  n  nonnegative-definite  state  weighting  matrix 

R2  m  x  m  positive-definite  control  weighting  matrix 

R i:  n  x  m  cross  weighting  matrix  such  that  R,  - 

Ri2R2  'R  fj  is  nonnegative  definite 
k  discrete-time  index,  1,  2,  3,  •••. 

in  the  statement  of  the  sampled-data  control  problem  the  sample 
interval  h  and  the  controller  order  nc  are  fixed  and  the  optimization  is 
performed  over  the  controller  parameters  (Ac,  Bc,  Cc,  Dc).  For  design 
tradeoff  studies  h  and  nc  can  be  varied  and  the  problem  can  be  solved  for 
each  pair  of  values  of  interest. 

Fixed-Order,  Sampled-Data  Dynamic-Compensation  Problem 


Given  the  nth-order  continuous-time  system 


x{t)  =  AxU)^Bu{l)  +  «-,(/) 

(2.1) 

with  continuous-time  measurements 

y(t)  =  Cx(t)  +  Du(t)+  w2(t) 

(2.2) 

design  an  nrth-order  discrete-time  compensator 

jrr(*+  \)  =  Arxc(k)  +  BJ(k), 

(2.3) 

ii{k)  =  Ccx,(k)  +  D,y(k), 

(2.4) 

which,  with  A/D  averaged  measurements 

,  1  f*‘ 

P!k)  fe  -  \  y(f)  dt 

"  •'(4  - 

(2.5) 

UOI8-9286/86/0900-0859J01.00  ©  1986  IEEE 
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and  D/A  zero-order-hold  controls 

u(/)  =  d(*),  r  6  [kh,  (Ar+I)A),  (2.6) 

minimizes  the  performance  criterion 

J(A„  B„  Cr,  De)  k  lim  E  - 

/-•  t 

■  (  ( x(s)TR,x{s)  +  2x(s)TRllu{s)  +  u(s)TR2u(s )1  ds.  (2.7) 

The  main  result  of  this  section  concerns  propagation  of  the  plant  and 
digitized  measurements  over  one  time  step.  For  notational  convenience, 
define 

H(s)  k  IV  dr. 

Jo 

Theorem  2.1:  For  the  fixed-order,  sampled-data  dynamic-compensa¬ 
tion  problem,  the  plant  dynamics  (2  1),  averaged  measurements  (2.S)  and 
performance  criterion  (2.7)  have  the  equivalent  discrete-time  representa¬ 
tions 

x'(fc+l)  =  A'x'(fc)  +  B'u(*)  +  w;(*),  (2.8) 

$(k)  =  C'x'(k-  1  )  +  D'u(k- l)  +  wi(k-  1),  (2.9) 

J(A,.  B„  Cc.  D<)  =  i+  lim  £[x'(k)rR  ix'(k) 

k—m 

+  2x'(k)TR  ,jiJ(*)  +  u(k)  TRiu(k)]  (2.10) 

where 

Jr'(Jt)  k  x (kh).  6  k  ^  tr  J*  j’  e^'V^’R,  dr  ds. 

A ■  &  eA\  B  k  H(h)B,  C'  k  \  CH(h),  D‘  k  ^  C  f*  H(s)  dsB  +  D, 

n  n  Jq 

w (k)  and  w{(k)  are  zero-mean,  white  noise  processes  with 


rr  wwi 

"  V{ 

V[2 

*v{(k)  J  J 

y'T 

L'n 

Vi  . 

where 

V ;  &  f"  eA‘V,e*r‘  ds.  V!i  k  t  f  eA‘V,HT(s)  dsCT+[  H(h)Vn, 

Vi  k  i  Fj  +  p  C  j*  H{s)VxHHs)  dsCT 

+  p  C  j*  His)  dsK(?  + 1  VTn  HHs)  dsCr; 
and 

Hi  =  T  (  e',r*B,e'u  ds.  R; ,  k  ;  e*T’R, His)  dsB  +  [  Hr(h)R,2. 

n  Jo  n  Jo  n 

R{  &  B;  +  {Br  (*  Hr(s)RtH{s)  dsB 
h  J<> 

+  J  BT  j*  HT{s)  dsRu  +  h  R{2  j*  H(s)  dsB. 

The  proof  of  this  theorem  is  a  straightforward  calculation  involving 
standard  techniques,  and  hence  is  omitted.  The  result  is  more  comprehen¬ 
sive  than  previous  work,  however,  and  includes  several  results  as  special 
cases.  For  example,  the  expressions  for  A  '  and  B'  are  standard;  C'  is 


given  by  (10.9),  (8,  p.  83);  R[,  R  fa,  and  Ri  are  given  in  [10],  [12J;  and 
V{,  V;2,  and  V{  can  be  found  in  (8,  p.  85).  The  expressions  for  6  and  /)' 
appear  to  be  new. 

Note  that  the  averaged  measurements  depend  upon  delayed  samples  of 
the  state.  By  augmenting  the  discretized  state  equation  (2.8)  to  include 
these  measurements,  it  is  possible  to  state  the  original  sampled-data 
problem  as  a  discrete-time  problem. 

Corollary  2.1:  With  the  notation 

[c  V]  • e  ‘  ['■]  • 

cm,,,,.  «.*«> * es[^,  £»],  ■ 

the  fixed-order,  sampled-data  dynamic -compensation  problem  is  equiva¬ 
lent  to  the  following  discrete-time  problem.  Given  the  ( n  +  /)th-order 
discrete-time  system 

i(*+  l)  =  Ai(*)+l9u(*)+w(*)  (2.11) 

with  discrete-time  measurements 

Hk)  =  Cx(k)  (2.12) 

design  an  nfth -order  discrete-time  compensator  of  the  form  (2.3),  (2.4), 
which  minimizes 

J(AC.  Br.  Ce.  Dt)  =  6+iim  E[x{k)T  R  Xx(k) 

+  2Hk)T  R  l2u(k)  +  6(k)TR2u(k)].  (2.13) 

Remark  2.1:  The  equivalent  cost  (2.13)  involves  a  constant  offset  6 
which  serves  as  a  lower  bound  on  the  sampled-data  performance,  i.e.,  a 
“discretization  floor."  Note  that 

«  =  j  tr  K,K,  +  0(/iJ). 

Remark  2.2:  Although  the  measurements  p(k)  are  noise  free,  the 
singularity  is  not  so  serious  as  singular  measurement  noise  in  the 
continuous-time  case  where  the  Kalman  filter  gains  are  expressed  in  terms 
of  the  inverse  of  the  measurement  noise  intensity.  In  the  discrete-time 
case,  rather,  it  is  required  that  *  +  CQCT  be  invertible,  where  P  is  the 
measurement  noise  covariance  (see  [11,  p.  530],  or  [15],  [16]). 

Remark  2.3:  The  increase  in  plant  order  from  n  to  n  +  /is  due  to  the 
computational  delay  and  A/D  process.  Since  discrete-time  LQG  theory 
yields  a  possibly  unwieldy  [n  +  /)th-order  controller,  we  seek  "reduced- 
order"  controllers.  Note  that  in  this  context  an  /tth-order  controller  can  be 
regarded  as  being  of  reduced  order. 

Remark  2.4:  As  pointed  out  in  [10],  particular  choices  of  the  sample 
interval  h  may  result  in  a  loss  of  controllability  and  observability  for  the 
equivalent  discrete-time  problem.  Hence,  these  properties  must  be 
verified  before  applying  control  design  methods. 

Ill  Application  of  the  Optimal  Projection  Equations  to  thf 
Equivalent  Discrete-Time  Problem 

We  now  apply  the  optimal  projection  equations  for  discrete-time 
dynamic  compensation  to  the  equivalent  discrete-time  problem.  The 
following  easily  proved  lemma  will  be  needed. 

Lemma  3.1:  Let  r  G  jy«»->/i  »<»♦')  Then 

t2«t. 


Mr)  •  n, 


(3  1) 
(32) 
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if  and  only  if  there  exist  G,  T  €  £»»■*«•♦«  such  that 

GT  r  =  r. 

r  cr-v 


(3.3) 

(3.4) 


Furthermore,  G  and  T  are  unique  to  a  change  of  basis  in  /f"<\ 

Call  C  and  T  satisfying  (3.3),  (3.4)  a  projective  factorization  of  t. 
Furthermore,  for  n  x  n  nonnegative-deftnite  matrices  Q.  and  (P,  define 
the  set  of  ccntragrediently  diagonalizing  transformations 

C(£t.  <P)  k  {*  €  R"x":  *  and  *7<P*  are  diagonal). 

It  follows  from  [19,  Theorem  6.2.5,  p.  123J  that  C(Q,,  <P)  is  always 
nonempty.  This  set  does  not,  however,  have  a  unique  element  since  basis 
rearrangements  and  sign  transpositions  may  be  incorporated  into  ♦. 
Further  nonuniqueness  arises  if  Q.(P  has  repeated  eigenvalues. 

To  guarantee  that  J  is  finite  and  independent  of  initial  conditions,  we 
restrict  our  consideration  to  the  (open)  set 


S  k 


fra  rt  r  ns  -  \  A  +  tDtC  ^,1 

j (A"  C"  D']  [  B,C  Ac  J 


is  stable  and  (A,,  Bc,  Cr)  is  minimal^  . 

For  the  design  problem  it  is  required  that  S  be  nonempty,  i.e.,  that  the 
augmented  system  be  stabilizable.  We  also  require  the  notation 

P2  k  fi2+6Tp6,  P2  k  CQCT.  Tj.  k  r, 

aq  k  A-AQCri>2-<C.  A,  &  A-6R;'(BtpA  +  A\2), 

ZQ  k  (AQCt+6d,P2)  P1'(AQCr  +  6d<  ?,) 7 

Zr  k  (6TpA+Rji-vR2DcC)TRi\BTPA4RjJ-vR2DcC), 


M 


‘  [a'e]  • M  -  [  • 

*  til  5:] 


P  =  A  rDr  rPrAo  +  Zp, 


where 


r  =  j  ♦£,* 


(3.12) 


(3.13) 


given  by 

J(Ae,  Bc,  C,  Z)f)  =  3  +  tr  [{MQMT+tiTQTTfiT)P\.  (3.14) 

Remark  3. 1:  Theorem  3.1  can  immediately  be  specialized  to  the  more 
restrictive  problem  in  which  the  compensator  is  strictly  proper.  This  can 
be  done  in  both  the  full-  and  reduced-order  cases  by  ignoring  (3.8)  and 
setting  Dc  =  0  wherever  it  appears.  See  [15],  [16). 

IV.  Numerical  Evaluation  of  Integrals  Involving  Matrix 
Exponentials 

To  evaluate  the  exponential/integral  expressions  appearing  in  Theorem 
2.1 ,  we  utilize  the  approach  of  [20).  The  idea  is  to  eliminate  the  need  for 
integration  by  computing  the  matrix  exponential  of  appropriate  block 
matrices.  Numerical  matrix  exponentiation  is  discussed  in  (21). 

Proposition  4. 1:  Consider  the  following  partitioned  matrix  exponen¬ 
tials  of  order  (3n  +  /)  x  (3n  +  /),  (3n  +  m)  x  (3n  +  m),  (2n  +  m) 
x  (2 n  +  m),  and  (3/t)  x  (in),  respectively: 


0**/ 

yl2 

cT 

0, 


Theorem  3.J :  Suppose  <AC,  Bc,  Cc,  Dc)  €  S  solves  the  fixed-order, 
sampled-data  dynamic-compensation  problem.  Then  there  exist  (n  +  l) 
x  (n  +  /)  nonnegative-defmite  matrices  Q,  P,  Q,  and  P  such  that  Ac, 
Bc,  Cc,  and  D,  are  given  by 

a,  =  T\A-AqCt9-2'C-bP;  '(6tpA  +  Rt0)-6D'C)Gt,  (3.5) 
B,=T\AqCt9-2'  +  6da.  (3.6) 

CV=  -\R;'(BTPA  +  fi\2)+D,C)G\  (3.7) 

Of  =  -g- '(BTPAQCT-rR\2QC7)^2\  (3.8) 

and  such  that  Q,  P,  Q,  and  P  satisfy 

Q=AQA  t-AqCtP,  'CqAt+  P+  <39> 

P=  A  TPA  - (6 ’PA  +  P 7 ) TR- '(6TPA  +  /? 7 )  +  R,  +  tt1Pt1.  (3. 10) 

<?  =  -4er(?Tr^J+Itf,  (3.| ,) 


F, 

Ft 

F2 

F. 

-A 

/. 

0. 

0. 

F, 

Ft 

Ft 

/ _ 

0. 

-A 

V , 

0. 

0, 

F, 

F , 

s  exp 

o. 

0. 

AT 

a,. 

0 

0 IXH 

I, 

0/,  H 

0 1.. 

Olx. 

Fu 

F>t 

£>] 

'  -AT 

1 . 

0. 

0, 

F« 

F„ 

F„ 

&  1 

0. 

-A  7 

R, 

0. 

o„ 

F,  7 

F„ 

s  exp 

0. 

o„ 

A 

o„„ 

Oh,  ■  it 

Oh,.. 

tm  j 

1 

0»  *  H 

0.1  XH 

om„ 

J 

■ 

/. 

F„ 

Fto' 

0„ 

I. 

0.x. 

0. 

Ft, 

Fa 

k  exp 

0„ 

A 

B 

0%** 

0  m.H 

0m.H 

0.1  XH 

0m 

• 

J 

• 

r  f2, 

F2. 

—  A 

l. 

0. 

0. 

F » 

Fv 

k  exp 

0. 

-A 

V , 

L  °- 

0, 

Ft, 

0, 

o„ 

>47 

Then 

A 1  = 

F„,  B‘ 

C'  = 

-  FT  D'  = 
h  »■ 

lcf„ 

+  D,  6  = 

1 

hU 

R 12 

B 

0„ 


h. 


h. 


h. 


for  some  ♦  €  C($,  /*)such  that  (♦"'(JAp )<,.,•>  *  0,  j  •  and 

some  projective  factorization  G,  f  of  r.  Furthermore,  the  minimal  cost  is 


y{-F*Fs.  V;2='-Ft,F„  Vi  =  {-(v2+l-  CF\F,  +  i  F\FtC^j  . 
*,'»j£7£5.  ;  £7£.,  R{=R2  +  \  (fi  7£7  £,  +  F[} F„B). 


V.  NUMERICAL  SOLUTION  OF  THE  DlSCRETE-TlME  OPTIMAL 
Projection  Equations 

The  following  algorithm  is  proposed  for  solving  (3.9)-(3.12). 

Algorithm  5.1: 

Step  I:  Initialize  k  =  0  and  r,0>  = 

Step  2:  With  r  A  t<*>  solve  (3.9)-(3. 12)  for  Q<*>  kQ.P1'  k  P,  <5<‘> 
ft  Q.  and  A*>  &  P 

Step  3:  If  A:  a  1  check  for  convergence:  If  [(Q'*1,  P(k\  @(tl,  P<t>)  - 
(Q<*~ p<*  - 1 »,  Q‘l  ",  p“  - H)||  >  to)  then  continue;  else  go 
to  Step  6. 

Step  4:  Select  *»»  €  e(Q'‘\  Pik>)  and  update  r«4,»  «  I"'., 
*•*»£,(♦«*')- '. 

Step  5:  Increment  k  and  go  to  Step  2 . 

Step  6:  Evaluate  (3.5)-(3.8)  with  Q  =  Q“\  P  -  A*1.  Q  -  <?<*'.  P 
-  A*\  CrT  *  r'*',  TO7  =  l.c. 

Remark  3.1:  In  solving  the  Riccati  equation  (3.9),  the  nonhomoge- 
neous  term  is  taken  to  be  9  +  ra  ^r7,  which  is  nonnegative  definite. 
Si  tilar  remarks  apply  to  (3.10). 


c 
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TABLE  I 

COST  J  FOR  BEAM  EXAMPLE 


X 

0 

.1 

.5 

12 

— 

1.3715 

3.0134 

10 

1.1677 

1.3723 

3.0134 

1 

1.1883 

1.3823 

3.0162 

6 

1.2086 

1.4421 

3.0195 

4 

1.3330 

1.5752 

3.0812 

2 

1.4789 

2.0425 

3.3406 

Opaa-Loop  Coat  (u=0)  ia  101 

73 

Remcrk  5.2:  The  critical  step  of  Algorithm  5. 1  is  the  choice  of  ♦<*>  for 
constructing  the  projection  Since  can  include  basis  rearrange¬ 
ments,  the  choice  of  ♦  |t|  essentially  corresponds  to  a  selection  of  nc  rank- 
I  eigenprojections  out  of  n  +  /  possible  eigenprojections.  This  selection 
is  discussed  at  length  in  (22]  where  it  is  pointed  out  that  the  choice  of 
eigenprojections  determines  which  local  extremal  will  be  reached  by  the 
algorithm.  Component-cost  methods  have  thus  been  utilized  as  a 
promising  selection  criteria.  Because  of  the  eigenprojection  structure  of 
the  necessary  conditions.  Algorithm  5. 1  is  fundamentally  different  from 
gradient  search  methods. 


VI  illustrative  Example:  Control  of  a  Flexible  Beam 

Consider  a  simply  supported  beam  of  length  two  with  two  colocated 
sensor/actuator  pairs  placed  at  coordinates  <7|  =  55/172  and  a2  =  45/43. 
Define 


A  =b!ock-diag  £  =  1=1,  •••,  5,  {-  =  0.005, 

B„,,  =  0.5(-  D'-'U  +  (-  l)1)  sin  (ixtfj/4), 

i=l,  •••,  10,  >=1,  2,  C-Br, 

V,  =block-diag  ,  Vl2  =  0,  V2  =  0.1/2, 

R,  =block-diag  ^  J^2J  .  =  *2  =  0.1/,. 


For  nc  *  10,  8,  6,  4,  2  continuous-time  controllers  were  designed  using 
the  results  of  f!7J  and,  for  nc  *  12,  10,  8,  6,  4,  2  and  A  *  0.1,  0.5, 
strictly  proper  (Dc  *  0)  discrete-time  controllers  were  obtained  from 
Theorem  3.1.  The  results  are  summarized  in  Table  I. 


vii.  Directions  for  Further  Developments 

The  following  extensions  and  related  developments  immediately 
suggest  themselves:  reduced-order,  discrete-time  modeling/estimation  of 


continuous-time  systems  [22),  [23]:  robust  sampled-data  control  of 
uncertain  systems  with  multiplicative  noise  [24J-[27];  multirate  sampling 
[28),  [29);  alternative  A/D  and  D/A  devices  and  asynchronous  sampling/ 
control  update;  infinite-dimensional  systems  [30],  (31).  . 
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Abstract:  The  optimal  projection  equations  obtained  in  (2,3]  for  reduced-order,  discrete-time  state  estimation  are  generalized  to 
include  the  effects  of  state-  and  measurement-dependent  noise  to  provide  a  model  of  parameter  uncertainty.  In  contrast  to  the  single 
matrix  Riccali  equation  arising  in  the  full-order  (Kalman  filter)  case,  the  optimal  steady-state  reduced-order  discrete-time  estimator  is 
characterized  by  three  matrix  equations  (one  modified  Riccati  equation  and  two  modified  Lyapunov  equations)  coupled  by  both  an 
oblique  projection  and  stochastic  effects. 

Keywords:  Reduced-order  Kalman  filter.  Robust  estimation. 


1.  Introduction 

In  a  recent  series  of  papers  [1-3]  it  has  been  sho*vn  that  the  first-order  necessary  conditions  for  optimal 
continuous  and  discrete-time  reduced-order  state-estimation  can  be  transformed  into  coupled  systems  of 
three  matrix  equations  (one  modified  Riccati  equation  and  two  modified  Lyapunov  equations).  The 
coupling  is  due  to  the  presence  of  an  oblique  projection  (idempotent  matrix)  which  arises  as  a  rigorous 
consequence  of  the  stationarity  conditions.  This  formulation  provides  a  direct  generalization  of  the 
classical  steady-state  Kalman  filter  theory.  Specifically,  in  the  full-order  case,  the  projection  becomes  the 
identity  matrix,  the  additional  two  modified  Lyapunov  equations  drop  out,  and  the  remaining  modified 
Riccati  equation  reduces  to  the  standard  observer  Riccati  equation  for  the  Kalman  filter  expression. 
Related  results  in  reduced-order  estimator  design  can  be  found  in  [4-17]. 

An  additional  extension  of  classical  state  estimation  involves  the  inclusion  of  state-  and  measurement- 
dependent  disturbances  [18-24],  One  motivation  for  such  a  model  is  to  design  estimators  which  are 
desensitized,  i.e.,  robustified,  to  actual  parameter  variations  [25-31].  For  the  continuous-time  control 
problem  this  has  been  justified  in  [32-38]. 

As  shown  in  [36]  for  the  continuous-time  case,  applying  the  optimal  projection  approach  to  the 
multiplicative  white  noise  model  yields  an  extended  formulation  of  the  optimality  conditions  for  reduced- 
order  state  estimation.  Specifically,  the  system  of  three  matrix  equations  characterizing  the  optimal 
estimator  are  now  coupled  by  both  the  oblique  projection  and  stochastic  effects. 

*  Supported  in  part  by  the  Air  Force  Office  of  Scientific  Research  under  contract  F49620-86-C-0002. 
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The  purpose  of  the  present  paper  is  to  provide  a  self-contained  derivation  of  the  optimality  conditions 
for  reduced-order  state  estimation  in  the  presence  of  both  state-  and  measurement-dependent  white  noise 
in  the  discrete-time  case.  The  goal  of  the  development  is  to  present  the  optimality  conditions  in  a  clear, 
concise  manner  to  facilitate  the  development  of  numerical  algorithms  for  practical  application. 


2.  Notation  and  definitions 

R,  Rrxs,  Rr,  E  real  numbers,  rXs  real  matrices,  RrX\  expectation. 
( )T,  ®  n  X  n  identity,  transpose,  Kronecker  product  [39], 

T±  fa-T,  T6R"X". 

n,  m,  /,  nc,  q  positive  integers,  1  <,ne<,n. 

x,  xe  n,  ne-dimensional  vectors. 

y,  ye  /,  ^-dimensional  vectors. 

A,  A,;  C,  Cj  nX  n  matrices,  lx  n  matrices,  i  =  1, . . . ,  p. 

Ac,  Be ,  Ct ,  Dc  ne  X  ne,  ntX  l,  qX  nt,  qX  l  matrices. 

k  discrete-time  index  1,  2,  3 . 

v,(k)  unit  variance  white  noise,  i  =  1,. . . ,  p. 

wx(k),  w2(£)  n-dimensional,  /-dimensional  white  noise  processes. 


Vi 


12 


R 

L 


A  = 


w(k)  = 


nXn  nonnegative-definite  covariance  of  wx(k). 
lx  l  positive-definite  covariance  of  w2(k). 
nxl  cross-covariance  of  u^/Ar),  w2(k). 
qxq  positive-definite  matrix. 
qXn  matrix. 


i-  1,...,  p. 


A  O' 

A,  O' 

B'C  At 

,  A,= 

B'C,  0 

w,{k) 

B'W2{k) 


V  = 


K  VX2Bl 
B'V il  B'V2B] 


R  = 


LtRL  -  LJRDcC  -  CTDjRL  +  CTDjRDeC  +  £  C^DJRD'C,  -  LtRC'  +  ctdJrc 


/-I 


-  CjRL  -I-  CjRDrC 


C'JRCc 


(i,  j  )  element  of  matrix  Z. 
rank  of  matrix  Z. 
trace  of  a  square  matrix  Z. 

square  matrix  with  unity  in  the  (i,  i )  position  and  zeros  elsewhere. 

> pE'tp*'  (unit-rank  eigenprojection). 

JC(Z),  &(Z)  null  space,  range  of  matrix  Z. 

An  asymptotically  stable  matrix  is  a  matrix  with  eigenvalues  in  the  open  unit  disk;  a  nonnegative-defi- 
nite  matrix  is  a  symmetric  matrix  with  nonnegative  eigenvalues;  and  a  positive-definite  matrix  is  a 
symmetric  matrix  with  positive  eigenvalues. 

For  arbitrary  n  X  n,  Q,  Q,  r,  define 


P(Z) 
tr  Z 

E, 


Vi^V2  +  CQCt+  ZQiQ  +  rQr^Cj,  Q^AQCr+Vl2  +  £  A,(Q  +  tQtt)C?, 


-1 
P 

I 

1-1 


f-1 


K  =V2  +  CQCr  +  £  C,(Q  +  e)C,T,  Qs  A  AQCT  +  Vu  +  £  Af(Q  +  Q)C ?. 

i-i 
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3.  Problem  statement  and  main  theorem 

Reduced-Order  State-Estimation  Problem.  Given  the  n-th-order  observed  system 

x{k  +  1)  =  1 +  wx(k),  (3.1) 

y(fc)  =  |c+  £  ^(£)C,j*0)  +  w2(k),  (3.2) 

design  an  ne-th  reduced-order  state  estimator 

xe(k  +  l)=A'Xe(k)  + Bey(k),  (3.3) 

yc{k)~C':X'(k)  +  Dcy(k),  (3.4) 

which  minimizes  the  state-estimation  error  criterion 

J(Ae,  Be,Ce,  Dc)±  \imE[Lx(k)-y'(k)}JR[Lx(k)-yc(k)}.  (3.5) 

k  -*  oo 

In  this  formulation  the  matrix  L  identifies  the  states,  or  linear  combinations  of  states,  whose  estimates 
are  desired.  The  order  nc  of  the  estimator  state  xc  is  determined  by  implementation  constraints,  i.e.,  by  the 
computing  capability  available  for  realizing  (3.3),  (3.4)  in  real  time.  Note  that  the  feedthrough  term  Dc 
permits  the  utilization  of  a  static  least  squares  estimator  in  conjunction  with  the  dynamic  estimator 
(Ac,  Bc,  Ce).  Thus,  the  goal  of  the  Reduced-Order  State-Estimation  Problem  is  to  design  an  estimator  of 
given  order  that  yields  quadratically  optimal  (least  squares)  estimates  of  specified  linear  combinations  of 
states. 

To  guarantee  that  J  is  finite  assume  that  A  is  asymptotically  stable  and  consider  the  set  of 
asymptotically  stable  reduced-order  (i.e.,  fixed-order)  estimators 

{ ( Ac,  Be,  Ce,  Dc):  Ar  is  asymptotically  stable) . 

Since  the  value  of  J  is  independent  of  the  internal  realization  of  the  transfer  function  corresponding  to 
(3.3)  and  (3.4),  without  loss  of  generality  we  further  restrict  our  attention  to  the  set  of  admissible 
estimators 

=  {(Ae,  Bc,  Ce,  Dc)^y:(Ae.  Be )  is  controllable  and  ( A c,  Ce)  is  observable) . 

The  following  factorization  lemma  is  needed  for  the  statement  of  the  main  result. 


Lemma  3.1.  Let  reR”x".  Then 

t2  =  t. 

(3.6) 

p(t)  =«t, 

if  and  only  if  there  exist  G,  TeR"'*"  such  that 

(3.7) 

gtt  =  t. 

(3.8) 

rcT  =  /„r 

Furthermore,  G  and  T  are  unique  to  a  change  of  basis  in  R"'. 

(3.9) 
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Proof.  See  [3].  □ 

For  convenience,  call  G  and  r  satisfying  (3.8)  and  (3.9)  a  projective  factorization  of  r.  Furthermore,  for 
n  X  n  nonnegative-definite  matrices  Q  and  P,  define  the  set  of  contragrediently  diagonalizing  transforma¬ 
tions 

@(Q,  P)“  (if£R"x":  ,P~lQ'l/~T  and  \pTP\p  are  diagonal } . 

It  follows  from  Theorem  6.2.5,  p.  123  of  [40],  that  2)(Q,  P)  is  always  nonempty.  This  set  does  not, 
however,  have  a  unique  element  since  basis  rearrangements  and  sign  transpositions  may  be  incorporated 
into  if'.  Further  nonuniqueness  arises  if  QP  has  repeated  eigenvalues. 

Theorem  3.1.  Suppose  A  is  asymptotically  stable  and  (Ae,  Be,  Ce,  De)s£P  +  solves  the  Optimal  Reduced- 
Order  State-Estimation  Problem.  Then  there  exist  nx  n  nonnegative-definite  matrices  Q.  Q  and  P  such  that 


Ae,  Bt,  C  and  Dc  are  given  by 

Ac  =  r(A-QsVfslC)GT,  (3.10) 

(3.11) 

Cc  =  (L-D'C)Gt,  (3.12) 

Dt  =  LQCTV{t\  (3.13) 

and  such  that  Q,  Q  and  P  satisfy 

p 

Q  =  AQAt+  ZMQi  t&T)aJ  +Vx  -  Q&Qj  +  r±Qrl ,  (3.14) 

i-i 

Q  =  AtQt7At  +  QsV2-'qJ,  (3.15) 

P=  (A  -  QsV2-'C)TrTPr(A  -  Q&C)  +  (L-  D'CfR(L-  DJC),  (3.16) 

where 

(3.17) 

1-1 

for  some  \ p  €  2(Q,  P)  such  that  (4,lQP4/)u.i)  ^  0,  i  =  1,  • .  • ,  and  some  projective  factorization  G,  F  of 

t.  Furthermore ,  the  minimal  cost  is  given  by 

J(At,  Bc,Cc ,  De)  =  tr[(L2LT-DsK2sZ>eT)K].  (3.18) 


Remark  3.1.  It  is  useful  to  note  that  (3.10)  can  be  replaced  by 

Ac  =  FAGT  -  BcCGt.  (3.10)' 

Remark  3.2.  Because  of  (3.9)  the  nXn  matrix  r  which  couples  the  three  equations  (3.14)— (3.16)  is 
idempotent,  i.e.,  t2  =  r.  In  general,  this  ‘optimal  projection’  is  an  oblique  projection  (as  opposed  to  an 
orthogonal  projection)  since  it  is  not  necessarily  symmetric.  It  should  be  stressed  that  the  form  of  the 
optima]  reduced-order  estimator  (3.10)— (3.13)  is  a  direct  consequence  of  optimality  and  not  the  result  of 
an  a  priori  assumption  on  the  structure  of  the  reduced-order  estimator. 


Remark  33.  To  specialize  the  result  to  the  strictly  proper  (no  feedthrough)  case,  merely  ignore  (3.13)  and 
set  =  0  wherever  it  appears. 
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Remark  3.4.  Replacing  xe  by  Sxc,  where  S  is  invertible,  yields  the  ‘equivalent’  estimator 
(SAeS~\  SBe,  CeS~\  D')  with  J(SAeS~\  SBe,  CeS~\  De)=J(Ac,  Bc,  Ce,  De).  Note  that  transforma¬ 
tion  of  the  estimator  state  basis  corresponds  to  the  alternative  factorization  r  =  (S~JG )T(Sr). 

Remark  3.5.  Note  that  for  the  optimal  values  of  Ae  and  Be  the  estimator  dynamics  (3.3)  assume  the  usual 
observer  form 

X'(k  +  1)  =  rAGTxe  +  r<2sV^(y  -  CGrxe).  (3.19) 

By  introducing  the  quasi-full-state  estimate  x  =  GTxe  GR"  so  that  tx  =  x  and  xe  =  Tx  eR1',  (3.19)  can 
be  written  as 

x(k  +  1)  =  rArx  +  tQsVfs1(y  —  Cx).  (3.20) 

Although  the  implemented  estimator  (3.19)  has  the  state  xe  s.  R  (3.19)  can  be  viewed  as  a  quasi-full-order 
estimator  whose  geometric  structure  is  entirely  dictated  by  the  projection  r  and  the  stochastic  effects. 
Specifically,  error  inputs  Q^V^iy  -  Cx)  are  annihilated  unless  they  are  contained  in  t)]  x  =  'jt( r r). 
Hence,  the  observation  subspace  of  the  estimator  is  precisely  ^(rT). 

Specializing  Theorem  3.1  to  the  noise-free  case  A,  =  0,  C,  =  0,  /  =  1, . . . ,  p,  yields  Theorem  2.2  of  [2,3]. 
Alternatively,  specializing  Theorem  3.1  to  the  full-order  case  ne  =  n  reveals  that  the  Lyapunov  equation  for 
P  is  superfluous.  In  this  case  it  follows  from  Remark  3.4  that  G-  T  ~  /„  without  loss  of  generality. 

Corollary  3.1.  Assume  ne  =  n,  A  is  asymptotically  stable  and  (Ac,  Bc,  Ce,  )  e  ,5^ +  solves  the  Optimal 
Full-Order  State-Estimation  Problem.  Then  there  exist  n  X  n  nonnegative-definite  matrices  Q  and  Q  such  that 


Ae,  Bc,  Ce  and  Dc  are  given  by 

A'  =  A-qA'C,  (3.21) 

B'  =  QsV2-s\  (3.22) 

C'  =  L-D'C,  (3.23) 

D'  =  LQCtV2-\  (3.24) 

and  such  that  Q  and  Q  satisfy 

Q  =  AQAt  +  ZA.iQ+QjAj (3.25) 
(-1 

Q  =  AQA1  +  Qfc'Ql.  (3.26) 

Furthermore ,  the  minimal  cost  is  given  by 

J(Ae,  Bc,  C',  Dt)  =  tr[(L2LT  -  DcVlsDj) r]  .  (3.27) 


Remark  3.6.  To  recover  the  standard  Kalman  filter  result  from  Corollary  3.1  set  A,  =  0,  C,  =  0. 

i  =  1 . p,  so  that  (3.25)  and  (3.26)  are  decoupled  and  (3.26)  is  superfluous.  Since  the  standard  Kalman 

filter  is  strictly  proper,  set  De  =  0  as  in  Remark  3.3. 


4.  Proof  of  the  main  theorem 


Using  the  notation  of  Section  2  the  augmented  system  (3.1)  and  (3.3)  can  be  written  as 
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where  x(k )  —  [jct(At>,  xJ(A:)]t.  To  analyze  (4.1)  it  is  useful  to  define  the  second-moment  matrix 

<2(*)  =  E[x(*)xt(*)].  (4.2) 

It  follows  from  (4.1)  and  (4.2)  that  Q(k)  must  satisfy 

p 

Q(k  +  1)  =  AQ{k)A*  +  E  A,Q(k)A]  +  V.  (4.3) 

i- 1 


Lemma  4.1.  Ae  is  asymptotically  stable  if  and  only  if 

p 

A  <g>  A  +  E  A,  ®  A, 
i-l 

is  asymptotically  stable. 

Proof.  The  result  follows  from  properties  of  the  Kronecker  product  applied  to  partitioned  matrices.  See 
[36]  for  details.  □ 


Hence  s&  stable  assures 
Q=  lim  e[x(A)xt(/c)] 

k  —  oo 

exists.  Furthermore,  Q  and  its  nonnegative-definite  dual  P  are  the  unique  solutions  of  the  modified 
Lyapunov  equations 


Q\ 

Qn 

B  _ 

Pi 

Pn 

Qn 

Qi. 

»  T  — 

Pn 

Pi. 

Q  =  AQA*  4-  E  A,QAj  +  P. 

i-l 
P 

P  =  A* PA  +  E  AjPA*  +  & ■ 

i-l 

Partition  ( n  +  ne)  X  (n  +  nc )  Q ,  P  into  n  X  n,  nX  ne,  and  ne  X  nc  subblocks  as 

Q 

and  define  the  n  x  n  nonnegative-definite  matrices 

Q 4  Qi~  QuQl 'Qn>  d  =  QnQl'Qh> 

Q±A$At+  Q&QJ,  (a-  QsV{>  lC  )J  P{  A  —  QsV2~  lC)  +  (L  -  DjcV  R(L -  DeC), 

A 

where  tQtt  is  replaced  by  Q  in  Qs  and  V2i  and  the  ne  X  n,  nex  ne,  neXn  matrices 

G^Q^QL  m±q2p2,  r±-P{'p?2. 

To  minimize  (3.5)  subject  to  the  constraint  (4.4),  form  the  Lagrangian 


(4.4) 

(4.5) 


*(A„  Be ,  Q,  D„  Q ,  P,  A)  At, 


A J(Ae,  Bt ,  Ce,  A)  +  AQA*  +  E  A.QAj  +V-Q  P 


f-1 


where  the  Lagrange  multipliers  A  ^  0  and  P  e  p^+n.>x<n+/,«)  are  not  both  zero.  Setting  d&/d Q  =  0,  A  =  0 
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implies  P  —  0  since  (Ae,  Be,  Ce,  De)  Hence,  without  loss  of  generality  set  A 
ity  conditions  are  given  by 


-afj&F  +  £  A’QAj  +V-Q-  0, 

or  i-i 

-  A? PA  +  £  AfPA,  +  R-P~  0, 

90  ,-i 

3if  T 

F 12^012  +  ^2^e^012  +  ^2^e02  =  0, 

|£  =  /»1T201  +  W2s  =  O, 

3^  =  -&L0n  +  *ACQ12  +  KQ02  =  0, 

9JSf* 

az). 


DcV2,-LQCr^0. 


=  1.  Thus  the  stationar- 

(4.6) 

(4.7) 

(4.8) 

(4.9) 

(4.10) 

(4.11) 


Expanding  (4.6)  and  (4.7)  yields 

p 

A(Q  +  Q)Ar  +  £  A,(q  +  q)aJ  +Vx-Q-Q~  0,  (4.12) 

/-I 

\A$AT  +  Q.V2~'Ql-6\rT-  0,  (4.13) 

r[A$AT  +  q,v2-'q!  -  £>\  r  -  0,  (4.14) 

[(A  ~  Qtl7tlC)TP{A  -  Q&C)  +  (L  -  D'C)rR{L  -  0eC)  -  P\gt  =  0,  (4.15) 

<?[(/<  -  0s^_slC)T^(/l  -  0,^'C)  +  (L  —  Z>eC)T*(Z.  -  2>eC)  -  /]  GT  =  0.  (4.16) 


Note  that  the  (1, 1)  subblock  of  equation  (4.7)  which  characterizes  P,  has  been  omitted  from  the  above 
equations  since  the  estimator  gains  are  independent  of  Pv 

Using  (4.8)-(4.11)  we  obtain  (3.10)-(3.13).  Using  (4.12)  +  GTr(4.13)G  -  (4.13)G  -  ((4.13)G))T  and 
GT(4.13)G  -  (4.13)G  -  ((4.13)G))t  +  (4.13)  -  (4.13)  yields  (3.14)  and  (3.15).  Using  rTG(4.15)T-  (4.15)T 
-((4.15)r))T  + (4.15) -(4.15)  yields  (3.16).  Finally,  r(4.13)-(4.14)  or  G(4.15)  -  (4.16)  yields  TGt  =  /„  . 
□ 
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Optimal  projection  equations  for  discrete-time  fixed-order 

dynamic  compensation  of  linear  systems  with  multiplicative  white  noise 

DENNIS  S.  BERNSTEINt  and  WASSIM  M.  HADDADJ 

The  optimal  projection  equations  for  discrete-time  reduced-order  dynamic  com¬ 
pensation  are  generalized  to  include  the  effects  of  state-,  control-  and  measurement- 
dependent  noise.  In  addition,  the  discrete-time  static  output  feedback  problem  with 
multiplicative  disturbances  is  considered.  For  both  problems,  the  design  equations 
are  presented  in  a  concise,  unified  manner  to  facilitate  their  accessibility  for 
developing  numerical  algorithms  for  practical  applications. 


Notation  and  definitions 

R,  RrxI,  R',  E 

® 


real  numbers,  rxs  real  matrices, 
n  x  n  identity,  transpose 
Kronecker  product 


Rrx  ‘,  expectation 


asymptotically 
stable  matrix 
non-negative- 
semisimple  matrix 
non-negative- 
definite  matrix 
positive-definite 
matrix 
n,  m,  /,  nc,  p 
x,  xc 

4,  A,;  B,  B„  C,  C, 
Ac,  fic,  Cc,  Dc 
k 

vAk) 
w,(k),  w2(k) 
Vu* i 

V,2 
R  1>  ^2 
Rl  2 

A,  A,- 


/,  —  t,  t£  R"x" 

matrix  with  eigenvalues  in  the  open  unit  disc 
semisimple  (diagonalizable)  matrix  with  non-negative  eigen¬ 
values 

symmetric  matrix  with  non-negative  eigenvalues 

symmetric  matrix  with  positive  eigenvalues 
positive  integers,  I  <  nc  $  n 
n-,  nc -dimensional  vectors 
m-,  /-dimensional  vectors 

n  x  n  matrices,  n  x  m  matrices.  /  x  n  matrices,  i  =  1, ....  p 

nc  x  rtc,  rtc  x  /,  m  x  nc,  m  x  /  matrices 

discrete-time  index  1,2,... 

unit  variance  white  noise,  i  =  1, ....  p 

n-dimensional,  /-dimensional  white  noise  processes 

n  x  n  covariance  of  w l  x  l  covariance  of  w2;  Vx  ^  0,  V2  >  0 

n  x  /  cross-covariance  of  w, ,  w2 

state  and  control  weightings;  R,  ^0,  R2  >0 

n  x  m  cross  weighting;  R,  -  Rl2R2  1  R[2  >  0 

A  +  BDcC,  A  j  +  BtDcC  +  fl£)cCj,  i  ~  1, ....  p 


w 


wt  +  BDcw2  + 
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P 

R 

X  X 

A ,  Aj 

» 


* 


7  . 
t-a.j) 

tr  Z 

P(Z) 

£, 

n,(iA) 


K  +  Vl2Dl B1  +  BDC V{2  +  BDC V2D] Br  +  £  B,DC K2Dj Bj 

i  =  1 

Ri+Rl2DcC  +  CJD]R]2  +  C'DlR2DcC+  £  CjDTcR2DcC, 


I"  .4  BCc~|  I"  Xt  B,c/ 

Lecc  \_B.C,  0 

r  F  Vl2B]  +  BD'V2BJ 

L  BcV?2  +  BcV2D]Bt  BqV2B] 
r  R  Rl2Cc  +  CTDTcR2C, 

LcjBTi  +  CR^c  C]  R2Cc 


( i,j )  element  of  matrix  Z 
trace  of  square  matrix  Z 
rank  of  matrix  Z 

matrix  with  unity  in  the  (/,  i)  position  and  zeros  elsewhere 
</r£,  Vl  (unit-rank  eigenprojection) 


For  arbitrary  n  x  n  Q,  P,  Q,  P,  x  define: 
^2,  =  v2  +  CQCT  +  £  C,QC] , 

f  =  1 

Q^AQC'+VX2+  £  A,QCJ, 

i=  l 

2+  £  A&CJ , 

t  -  1 

^  =  ^2  +  CQCT  +  £  <?,«?  +  xQxT)Cj. 

i  =  1 

Q54/tQCT+Fu+  £  /Ue  +  TCTT)CT, 

t  =  1 

C,>=  ^u  +  £  ^(Q  +  tQr^Cf, 

i  =  1 


R2sAR2  +  BjPB+  £  B^PB, 

1=  1 

Ps4BTW+i?f,+  £  B,TP4, 

i  =  1 

PJ1  =  «I2+  £  Bj PAj 

l  =  1 

R2sAR2  +  BrPB+  £  Bj{P  +  xJPx)Bi 

i  =  1 

Ps4BtP4  +  RI2+  £  B7(P  +  ttPtM, 
»'=  1 

p,.  =  RT2  +  £  B^P  +  ^Pt)/!,. 

i'=  t 


1.  Introduction 

Hyland  and  Bernstein  (1984)  showed  that  the  first-order  necessary  conditions  for 
quadratically  optimal  continuous-time  fixed-order  dynamic  compensation  can  be 
transformed  into  a  coupled  system  of  four  matrix  equations  (two  modified  Riccati 
equations  and  two  modified  Lyapunov  equations).  The  coupling  is  due  to  the  presence 
of  an  oblique  projection  (idempotent  matrix)  which  arises  as  a  rigorous  consequence 
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of  optimality.  This  formulation  provides  a  generalization  of  classical  LQG  control 
theory,  since  in  the  full-order  case  the  projection  becomes  the  identity  matrix,  the 
modified  Lyapunov  equations  drop  out,  and  the  modified  Riccati  equations  reduce  to 
the  usual  LQG  equations.  Coupling  via  the  optimal  projection  implies  that  sequential 
reduced-order  design  procedures  consisting  of  either  model  reduction  followed  by 
controller  design  or  controller  design  followed  by  controller  reduction  are  generally 
suboptimal.  Furthermore,  the  coupled  structure  of  the  equations  yields  the  insight 
that  in  the  reduced-order  case  there  is  no  longer  separation  between  the  operations  of 
state  estimation  and  state-estimate  feedback,  i.e.  the  certainty  equivalence  principle 
breaks  down. 

The  above  developments  for  the  continuous-time  problem  have,  moreover,  been 
carried  out  by  Bernstein,  Davis  and  Hyland  (1986)  in  a  discrete-time  setting.  As  in  the 
continuous-time  case,  the  optimal  reduced-order  compensator  is  characterized  by  a 
pair  of  modified  Riccati  equations  and  a  pair  of  modified  Lyapunov  equations 
coupled  by  an  oblique  projection.  Furthermore,  because  of  the  discrete-time  setting  it 
is  now  possible  to  permit  static  feedthrough  gains  in  both  the  full-  and  reduced-order 
controller  designs.  As  pointed  out  by  Hyland  and  Bernstein  (1984).  non-singular 
control  weighting  and  measurement  noise  in  the  continuous-time  case  permit  only  a 
purely  dynamic  (strictly  proper)  controller.  Note  that  this  is  precisely  the  case  in 
continuous-time  LQG  theory,  which  yields  strictly  proper  feedback  controllers. 

An  immediate  application  of  the  discrete-time  results  is  a  rigorous  treatment  of  the 
linear-quadratic  sampled-data  reduced-order  dynamic-compensation  problem  (Bern¬ 
stein,  Davis  and  Greeley  1986).  By  explicitly  accounting  for  real-time  computational 
delay  in  the  feedback  loop,  the  sampled-data  control-design  problem  can  be 
transformed  into  an  equivalent  discrete-time  problem.  The  dimension  of  the  equiva¬ 
lent  discrete-time  system,  however,  is  augmented  by  the  available  measurements 
which  are  treated  as  delay  states.  The  optimal  projection  equations  for  discrete-time 
fixed-order  dynamic  compensation  can  thus  be  used  to  obtain  controllers  of  tractably 
low  dimension  in  spite  of  dimension  augmentation. 

Design  considerations  concerning  stability  and  performance  robustness  with 
respect  to  unknown  parameter  variations  can  also  be  incorporated  into  the  fixed- 
order  dynamic-compensation  design  process.  This  can  be  accomplished  by  introduc¬ 
ing  white  noise  into  the  plant  via  the  imperfectly  known  parameters  (Bernstein  and 
Hyland  1985,  Bernstein  and  Greeley  1986  a).  Intuitively  speaking,  the  quadratically 
optimal  feedback  controller  designed  in  the  presence  of  such  disturbances  is 
automatically  desensitized  to  actual  parameter  variations.  As  shown  by  Bernstein  and 
Greeley  (1986  b),  the  modification  of  the  closed-loop  covariance  equation  due  to 
multiplicative  noise  can  be  used  to  guarantee  robust  stability  and  performance  by 
means  of  a  Lyapunov  function  and  a  performance  bound. 

An  interesting  aspect  of  the  design  equations  for  the  multiplicative  noise  model  is 
the  breakdown  of  the  separation  principle  even  in  the  full-order  case.  That  is,  even 
when  coupling  due  to  the  oblique  projection  is  absent,  coupling  due  to  stochastic 
effects  remains.  This  is  a  graphic  portrayal  of  observations  made  previously,  e  g.  by 
Gustafson  and  Speyer  (1975).  An  alternative,  apparently  suboptima!  approach 
involving  certainty  equivalent  controllers  for  guaranteeing  stochastic  stability  was 
developed  by  Yaz  (1986). 

The  purpose  of  the  present  paper  is  to  extend  the  optimal  projection  equations  for 
fixed-order  discrete-time  dynamic  compensation  given  by  Bernstein,  Davis  and 
Hyland  (1986)  to  include  the  effects  of  state-,  control-  and  measurement-dependent 
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white  noise.  The  main  result  (Theorem  3.1)  presents  the  necessary  conditions  for 
optimality  as  a  system  of  four  matrix  equations  (two  modified  discrete-time  Riccati 
equations  and  two  modified  discrete-time  Lyapunov  equations)  coupled  by  both  the 
optimal  projection  and  stochastic  effects.  For  the  sake  of  completeness,  the  optimality 
conditions  for  discrete-time  static  output  feedback  are  given  by  Theorem  2. 1 . 


2.  Static  output  feedback 

2.1.  Discrete-time  static  output-feedback  problem 
Given  the  controlled  system 

x(k  +  1)  =  f/1  +  £  Vi(k)A^jx{k)  +  +  £ 

yik)  =  (c  +  £  Vi(k)C^x(k)  +  w2 (k)  (2) 

where  k=  1, 2, ...,  determine  Dc  such  that  the  static  output  feedback  law 

u(fc)  =  Dcy{k)  (3) 

minimizes  the  performance  criterion 

JA  lim  E\_x1(k)Rlx(k)  +  2xT(k)Rl2u(k)  +  ur(k)R2u(k)^  (4) 

*  —  X 

Using  the  notation  given  at  the  beginning  of  this  paper,  the  closed-loop  system 
(1)— (3)  can  be  written  as 


Mk)B<Ju(k)  +  w,(k)  (i) 


x(k  +  1 )  = 


^-4  +  £  r,(kM,^  x{k)  +  w(k) 


Define  the  second-moment  matrix 

Q(k)=  E[.v(k).xT(k)] 


satisfying 


(5) 

(6) 


Q(k  +  1)  =  <4(2(fc)iT  +  £  A&k)A?  +  V  (7) 

i=  i 

To  consider  the  steady  state,  we  restrict  our  consideration  to  the  set  of  second-moment 
stabilizing  gains 


S4  |/)c :  /4  (g)  ^4  -F  £  ,4,®  4,  is  asymptotically  stable 

The  requirement  Dc  6  S  implies  the  existence  of  the  steady-state  closed-loop  state 
covariance  QA  lim  Q{k).  Furthermore,  Q  and  its  non-negative-definite  dual  P  are 

k-»  oo 

unique  solutions  of  the  modified  discrete-time  Lyapunov  equations 

Q=AQAT+  £  AtQAj+  V  (8) 

i  *  1 

P  =  ArPA  +  £  AjPAf  +  R 
1=1 


(9) 
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An  additional  technical  requirement  is  that  Dc  be  confined  to  the  set 
S+  A  {Dc  e  S:  K2j  >  0  and  R2s>  0} 

In  order  to  obtain  closed-form  expressions  for  extremal  values  of  the  closed-loop 
control  gains,  the  static-  and  dynamic-compensation  problems  require  the  technical 
assumption 

[B,*0=#.C,»0]f  i  =  1, p  (10) 

i.e.  for  each  i  e  {1, p},  B,  and  C,  are  not  both  non-zero.  Essentially,  (10)  expresses 
the  condition  that  the  control-dependent  and  measurement-dependent  noises  are 
independent.  There  are  no  constraints,  however,  on  correlation  with  the  state- 
dependent  noise.  By  optimizing  (4)  with  respect  to  Dc  and  manipulating  (8)  and  (9),  we 
obtain  the  following  result. 

Theorem  2.1 

Suppose  Dc  e  S  +  solves  the  discrete-time  static  output-feedback  problem.  Then 
there  exist  n  x  n  Q,  P  ^  0  such  that 

Dc= -R2sl[BTPAQCT  +  PslQCT+BTPQsl]y2;‘  (11) 

and  such  that  Q  and  P  satisfy 

Q  =  AQAr  +  Vx  +  £  CM<  +  WtfMi  +  +  B,DcV2D] BT] 

1=  1 

+  (Qs  +  BDC V2,)V2-S  1  (Qs  +  BDC v2 , )T  -  Qs VlsQ]  ( 1 2) 

P=AyPA  +  R,+  £  [(/4,  +  BDcCj)TP(/l1  +  BDcCj)  +  Cj D] R1DcCi~\ 

1=  1 

+  (P,+  R2sDcC)tRI,HPs  +  RzsD'C)- PlRiA  (13) 


3.  Dynamic  output  feedback 

We  now  expand  the  formulation  of  the  static  problem  to  include  a  dynamic 
compensator. 

3.1.  Discrete-time  dynamic  output-feedback  problem 

Given  the  controlled  system  (1),  (2),  determine  Ac,  Bc,C^,  Dc  such  that  the  dynamic 
output-feedback  law 

xc(k  +  1)  =  4cxc(fc)  +  Bc.v(fe)  (14) 

u(k)  =  Cc.xjk)  +  Dc\<k)  (15) 

minimizes  the  performance  criterion  (4). 

We  restrict  our  attention  to  the  second-moment-stabilizing  controllers 

§4  j(4c,  Bc,  Cc,  DJ:  A  +  £  4,  is  asymptotically  stable  and 

"  1 
(,4C,  Bc,  CJ  is  minimal  > 


which  implies  the  existence  of  $4  lim  E[x(fc)xT(fc)],  where  x(k)4  [xT(k),  xJk)]T. 
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Furthermore,  Q  and  its  non-negative-definite  dual  P  are  the  unique  solutions  to  the 
modified  discrete-time  Lyapunov  equations 

£  =  404T  +  £  AiQ^J+  $  06) 

i  =  1 

P=AJPA+  £  AjPAi  +  k  (17) 

i  =  1 

An  additional  technical  assumption  is  that  (4C,  Cc,  Dc)  be  confined  to  the  set 
$+4  {(A'.B'Xc.DJeS:  R2s>0  and  F2j>0} 

The  following  lemma  is  required. 

Lemma  3.1 

Let  r  e  R"  * Then 

r2  =  r 
P(t)  =  «c 

if  and  only  if  there  exist  G,  T  e  R"tX"  such  that 

GTr  =  r 
rcT  =  /„c 


(18) 

(19) 

(20) 
(21) 


Proof 

See  Bernstein.  Davis  and  Hyland  (1986). 

For  convenience  call  G  and  T  satisfying  (20)  and  (21)  a  projective  factorization  of  r. 
Furthermore,  for  n  x  «  non-negative-definite  matrices  Q.  P.  define  the  set  of  contragre- 
diently  diagonalizing  transformations  (see  Rao  and  Mitra  1971.  p.  123) 

D(Q.  P)A  [ijj  e  R"xm:  'Qip'1  and  ipJ Pij/  are  diagonal' 


Theorem  3.1 

Suppose  (4C,  Bc.  Cc,  Dc)  e  S*  solves  the  discrete-time  dynamic  output-feedback 


problem.  Then  there  exist  n  x  n  Q,  P.  Q,  P  ^  0  such  that 

=  T[4  -  BRjf  P3  -  QSu  '  C  -  BDcC\GT  (22) 

=  r[QjF2j '  +  BDC]  (23) 

Cc=-[fcP,  +  DeC]GT  (24) 

Dc  =  -R2V  [BtPAQCt  +  Ps1QCt  +  BTPQsl]V,;  1  (25) 

and  such  that  Q,  P,  Q,  P  satisfy 


Q  =  AQA T  +  F,  +  x.Qxl  +  £  [(.4,  -  B,RU'  P^Qr^A,  -  Bfc,'  PS)T 

i=  1 

+  (4,  +  B,DcC)e(4,  +  B,DcC)T  +  B,DcK,Oj Bj]  -  Qs V{s  1  Qj 


(26) 
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P  =  AJPA  +  Rt+  tTiPr1  +  t  [Ml  -  QA: 1  C,)tttPt(A,  -  QSV{S  1 C.) 

i  ~  1 

+  (At  +  BDcCi)r P(Ai  +  BDcCi)  +  CjDJcR2DcCJ  -  P J Rjf  Ps  (27) 

Q  =  M  -  BR i‘  P,)tQttM  -  BR2- 1  PS)T  +  (Qs  +  BDci'2s)V2st(Qs  +  BDcV2s)T  (28) 
P  =  (A  -  Q,V{, 1  C)ttt Pz(A  -  Q,V2~ 1 C)  +  (P3  +  R2sDcC)rR2,'[P,  +  R2jDcC)  (29) 
where 

rA  £  n,#)  =  GTr  (30) 

i=  1 

for  some  \p  e  D(Q,  P)  such  that  (i jj  ~ 1  QPil/){ U)  #0,  i  =  1 . nc,  and  some  projective 

factorization  G,  T  of  x. 


Remark  3.1 

To  specialize  the  result  to  the  strictly  proper  (no  feedthrough)  case,  merely  ignore 
(25)  and  set  Dc-  0  wherever  it  appears. 

Remark  3.2 

As  previously  pointed  out  by  Bernstein.  Davis  and  Hyland  (1986),  the  indeter¬ 
minacy  in  specifying  the  projective  factorization  G,  T  satisfying  (20)  and  (21) 
corresponds  to  an  arbitrary  choice  of  internal  state-space  basis  for  the  design  system 

M«,  Be  Cc). 


Remark  3.3 

In  the  full-order  case  wc  =  n ,  the  projection  r  becomes  the  identity  and  (28)  and  (29) 
play  no  role.  In  this  case  GTT  =  TGt  =  /„  and  thus  G  and  V  can  be  chosen  to  be  the 
identity.  Deleting  all  multiplicative  white  noise  terms  corresponding  to  state-,  control- 
and  measurement-dependent  disturbances,  i.e.  Ah  B,.  C,  =  0.  i  =  1 . p,  and  specializ¬ 

ing  further  to  the  purely  dynamic  case  (Dc  =  0)  yields  the  standard  LQG  result. 
Alternatively,  setting  nc  <  n  and  deleting  the  multiplicative  noise  terms  yields  the 
results  of  Bernstein,  Davis  and  Hyland  (1986). 


4.  Proof  of  Theorem  3.1 

Partition  (n  +  nc)  x  (n  +  n,.)  (5,  P  into  n  x  n.  n  x  nc,  and  nc  x  nc  sub-blocks  as 


re, 

c.r 

~  Pi 

«o 

• — 1 
r 

Qz_ 

.  p  = 

_p]2 

“0 

l-l 

1 _ 

and  define  the  n  x  n  non-negative-definite  matrices 

Q  =  Qi  -QuQj'Qlz,  P4P1-PuP2'1P|2 
$±Q<zQrQL'  Mpi2p2'p}2 

Q  =  (A-  BR 2- ‘ P,)Q(A  -  BRjf  P,)T  +  ( Q ,  +  BDCV2,)V{,'(Q>  +  BDcVu)y 
R= M  -  Q,V2 - 1  C)T  A/1  -  Q,V{, '  C)  +  (A  +  B2jZ)tC)TR2- l(Ps  +  R2jDcC) 
where  tQzt  and  tTPr  in  <5S,  P„  V2,,  and  P2s  are  replaced  by  Q  and  P,  and  the  nc  x  n. 
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nc  x  nc,  and  ncx  n  matrices 


G±QAQA  m±q2p2,  r  a  -p21p\2 

Define  the  lagrangian 


UAC,  Bc,  Cc,  Dc,  Q ,  P,  A)4  tr  AJMC,  Bc,  Cc,  Dc)  +  +  £  3,(537  +  K  -  Q^P 


where  the  Lagrange  multipliers  A  ^  0  and  P  e  Rf"+»c>*<"+»c>  are  not  both  zero  setting 
dL/dQ  =  0,  A  =  0  implies  P  =  0  since  Mc,  Bc,  Cc,  Dc)  e  S  +  .  Hence,  without  loss  of 
generality,  set  A  =  1.  Thus  the  stationarity  conditions  are  given  by 


dL 

SP 

dL 


=  aqat  +  £  3,(537  +  v-  Q  =  o 


dQ 


i=  l 
P 

1 

i  =  1 


=  3tp3  +  X  3tP3  +  8-p  =  o 


Jj-'  =  +  P|2BDcCQ12  +  Pl2BCce2  +  P2AcQ2+  P2BcCQ12  =  0  (33) 

(34) 


^  =  p2bc  k2j  +  p]2  qs  +  p]2bdc  v2i  =  o 


dL 


—  P;Q  1 2  +  RiAcQ2  A-  R2sDcCQl2  —  0 


—  =  R2sDcK2j  +  BTP^QCT  +  PuQCr  +  BrPQsl=0 


Expanding  (31)  and  (32)  yields 

AQAT  +  (Qs  +  BD'VU)V;,'(QS  +  BDCV2A  -  QAu '  Ql 
+  (A  -  bra  p,)&a  -  brA  pa 

+  Vl-Q-$+  £  [(/I,  -  b,r2,'  Pt)C(A,  -  b.rA  pa 


(31) 

(32) 


(35) 

(36) 


+  (A-,  +  B,DA)Q{A,  +  B,Z>cC)T  +  fl,Oc  K2Z>ct BH  «  0  (37) 

[(&  +  BDCV2,)V2- 1  ((?,  +  bdA2A  +  (-4  -  bb2- 1  p,)Q[A  -  bra  pa  -  Q]rT  =  o 


(38) 

r[(Q5  +  bdAuA:  '(4  +  bdc  +  v2A 

A- {A  —  BRA  pMa  -  BRA  PA  -  d]rT  =  o  (39) 
AT  PA  +  A,  +  r2,D'C)tRA  A  +  Ri  AC)  -  P7  b2V  p, 
+(^-e3^lc)TPM-gJK2;lc) 

+  B.-P-P+  £  [M,  -  QAu  1  C,)T  Ha,  -  QAu 1 C.) 

i  =  1 

+  (/l,  +  BOcC,)T  PM,  +  BDcCi)  +  cj  Dj  fi2DcC,]  =  0  (40) 

[(P,  +  R2,DcC)yRA(P,  +  R2,DcC)  A- (A-  QAu  1  C)tPM  -  1 C)  -  ^]GT  =  0 
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G[(P,  +  R2sDcC)tRu'(P ,  +  R2,DcC)  +(A-  qA:  1  C)yP(A  -  QA: 1 C)  -  ^]GT  =  0 

(42) 

Using  (33)— (36)  we  obtain  (22)-(25).  Using  (37)  +  GTT(38)G  -  (38)G  -  (38G)T  and 
GTr(38)G-(38)G-(38G)T  yields  (26)  and  (28).  Similarly,  using  (40)  +  rTG|41)r 
—  (41)r  —  (4ir)T  and  rTG(41)r  —  (41)r  —  (41  nT  we  obtain  (27)  and  (29).  Also, 
T(38)-(39);or  G(41)  —  (42J  yields  VGT  =  I„c  so  that  r  =  GT  =  r2.  Finally.  (39)  and 
(42)  imply  Q  =  rQr7  and  P  =  t7Px.  □ 

Remark  4.1 

An  interesting  difference  between  the  above  discrete-time  derivation  and  the 
continuous-time  derivation  of  Hyland  and  Bernstein  (1984)  is  that  the  explicit  gain 
expressions  and  the  definition  of  the  optimal  projection  arise  in  the  reverse  order. 

S.  Directions  for  further  research 

The  principal  application  of  Theorems  2. 1  and  3. 1  is  the  sampled-data  problem  with 
parameter  uncertainties.  Although  generalization  of  the  results  of  Bernstein  et  al. 
(1986)  is  possible,  there  appear  to  be  a  number  of  mathematical  issues  which 
arise.  A  related  development  appears  in  Tiedemann  and  De  Koning  (1984).  A  more 
extensive  treatment  of  the  results  of  the  present  paper  can  be  found  in  Haddad  (1987). 

Acknowledgment 

Dr.  Bernstein  was  supported  in  part  by  the  Air  Force  Office  of  Scientific  Research 
under  contract  AFOSR  F49620-86-C-0002. 

References 

Bernstein,  D.  S.,  Davis.  L.  D..  and  Greeley,  S.  W..  1986, 1.E.E.E.  Trans,  autom.  Control,  31, 859. 
Bernstein,  D.  S.,  Davis,  L.  D.,  and  Hyland,  D.  C.,  1986.  J.  Guid.  Control  Dynam..  9,  288. 
Bernstein,  D.  S.,  and  Greeley,  S.  W„  1986  a,  I.E.E.E.  Trans,  autom.  Control.  31,  362:  1986  b. 

Proc.  American  Control  Conf.,  Seattle,  WA,  pp.  1818  -  1826. 

Bernstein,  D.  S.,  and  Hyland,  D.  C.,  1985,  Proc.  24th  I.E.E.E.  Conf.  on  Decision  and  Control. 
Fort  Lauderdale,  FL,  pp.  745-752. 

Gustafson.  D.  E.,  and  Speyer,  J.  L.,  1975,  J.  Spacecraft  Rockets.  12,  351. 

Haddad,  W.  M.,  1987,  Robust  optimal  projection  control-system  synthesis.  Ph.D.  dissertation. 

Department  of  Mechanical  Engineering,  Florida  Institute  of  Technology. 

Hyland.  D.  C.,  and  Bernstein,  D.  S.,  1984,  I.E.E.E.  Trans,  autom.  Control.  29,  1034. 

Rao,  C.  R.,  and  Mitra,  S.  K.,  1971,  Generated  Inverse  of  Matrices  and  [ts  Applications  (New 
York:  Wiley). 

Tiedemann,  A.  R.,  and  De  Koning.  W.  L„  1984,  Int.  J.  Control.  70,  449. 

Yaz,  E.,  1986,  I.E.E.E.  Trans,  autom.  Control.  31,  586. 


SIAM  J  Matrix  anal.  Am 
Voi.  9.  No  2.  Apnl  1988 


C  1988  Society  for  Industna)  and  Applied  Mathematics 

oo: 


INEQUALITIES  FOR  THE  TRACE  OF  MATRIX  EXPONENTIALS* 

DENNIS  S.  BERNSTEINt 

Abstract.  Several  inequalities  involving  the  trace  of  matrix  exponentials  are  derived  The  Golden-Thompxon 
inequality  tr  c*  '  *  £  tr  »■  Y®  for  symmetric  t  and  B  is  obtained  as  a  special  case  along  with  the  new  inequality 
tr  e  Y<r  £  tr  e*  * ,r  for  nonnormal  A. 

Key  words,  matnx  exponential,  inequality,  trace 

AMSfMOS)  subject  classification.  1 5 

1.  Introduction.  For/i^  n  real  symmetric  matrices  A  and  H.  the  Golden-Thompson 
inequality  [  I  J-(5]  states  that 

(LI)  tr  <• 1 '  tr  c4c". 

Reference  (5]  generalizes  ( 1 . 1 )  to  allow  arbitrary  spectral  functions  in  place  of  the  trace 
operator  and  provides  an  overview  of  applications  in  w  hich  these  inequalities  arise. 

In  contrast  to  (1.1).  problems  in  linear-quadratic  optima)  feedback  control  [6]  typ¬ 
ically  involve  a  performance  functional  J  of  the  form 

(1.2)  J=tr  j  eA'Vv*uRdt. 

Jo 

where  I  and  R  denote  noise  intensity  and  performance  weighting  matrices,  respectively  , 
and  A  denotes  the  linear  system  dynamics  matrix.  The  form  of  (1.2)  thus  suggests  in¬ 
equalities  of  the  form  (1.1)  involving  A  and  A1,  where  A  is  nonnormal,  in  place  of 
symmetric  A  and  B.  Such  inequalities  are  motivated  b>  robust  sampled-data  control- 
design  problems  yxhich  require  performance  bounds  for  uncertain  system  models. 

The  main  result  of  the  present  note  is  the  inequality 


(1.3) 

tr  <■  V  1  £  tr  <• 1  ‘  1  . 

Rather  surprisingly,  the  sign  of  the  inequality  (1.3)  is  opposite  to  the  sign  of  (1.1).  To 
understand  w  hy  this  is  the  case,  we  derive  a  series  of  inequalities  which,  upon  appropriate 
specialization,  yield  both  ( 1 .  i )  and  ( 1 .3). 

2.  Inequalities.  The  following  lemma  is  required.  (Let  ( 
a  matrix  (  .) 

Li  mm  \  2  1  li  t  e:  R'  ’  anil  r  /'  <t  i>t’\iiivc  inn  ui'i.  then 

1  denote  the  transpose  of 

(2.1) 

tr  <  tr  (  T''£  tr  ((  (  ' )'. 

Rroni  1  he  first  inequality  follows  from  tr  i("  -  (  '')((’ 
second  follows  from  a  result  of  K.  Fan  (see  |4.  pp.  234.  5I(')> 
Till  OKI  M  2.1 .  II  A.  B  €  R’  then 

’'-(  ')>().  while  the 
D 

tr  o'"  *£trr" 

I  ■  II)  .'t,(  i  •  hi',:  .  I  i  •  1 '  ■  it  .  II')  ; 

< - 1 

Lire"'  tr  (<• '  ' 

''4C"'"'). 

treV"  i 

(2.3) 

Jtrri^-H^) 

£  J  tr(c  V'  +  cV"')£  (  tr  (o  '  * 
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Proof.  Defining  C  =  eA,2reBl2\  (2.1)  becomes 

tr  (eA/2rem2')2r  £  tr  (cAf2reBn')'(cBT/2'eAT,2rY  £  tr  {eJ'/2rcB,2refiT,2re‘,T/2r)'. 

Letting  r  -*  cr_,  the  exponential  product  formula  [5.  p.  60]  and  its  generalization 
[7.  p.  97]  yield  the  first  two  inequalities  of  (2.2).  The  third  inequality  of  (2.2)  follows 
from  Corollary  3  of  [5]  while  the  fourth  inequality  of  (2.2)  follows  from 

0Str[,'HM'l/!-eWlsr|/-]; 


To  prove  (2.3)  note  that  the  upper  leftmost  inequality  follows  from  0  £ 
tr  (*.*•"*  -  eB)U’A  ~  c11)7 .  The  remaining  inequalities  in  (2.3)  follow  from  tr  £ 
tr  eAe*T  £  tr  e4"  a1  .  which  is  a  consequence  of  (2.2)  with  B  =  A.  □ 

Corollary  2.1.  If  A  €  R’  ‘ ",  then 


(2.4) 


(2.5) 


tr  £  "  +  -  tr  e2Ae2Al  £  ^  tr  ^  ^ 


If  A,  B  €  R"* "  arc  symmetric,  then 

(2.6)  tr  eA  *  8  £  tr  eAeB  £  (  tr  ( e~ 1  +  c2B). 

Proof  The  first  two  inequalities  of  (2.4)  follow  from  the  first  two  inequalities  of 
(2.2)  with  B  =  A  The  last  inequality  of  (2.4)  follows  from  the  last  inequality  of  (2.2)  with 
B  ~  0  and  A  replaced  by  2.4.  Inequalities  (2.5)  follow  from  (2.3)  with  B  =  0  and  A 
replaced  by  2.4  while  ignoring  the  lower  leftmost  term  in  (2.3).  Finally.  (2.6)  follows 
from  (2.2).  □ 

Remark  The  second  inequality  in  (2.4)  and  the  first  inequality  in  (2.6)  correspond 
to  ( 1 .3)  and  (l.l).  respectively. 


3.  Additional  inequalities.  The  question  immediately  arises  as  to  whether  any  ad¬ 
ditional  inequalities  involving  the  expressions  appearing  in  (2.4)  and  (2.5)  are  true.  Note 
that  tr  eAeH  in  (2.3)  cannot  be  merged  with  (2.2)  because  of  the  sign  reversal  between 
(1.1)  and  (1.3).  It  can  readily  be  seen  that  the  only  remaining  possibilities  are 


(3  1) 

tr  c'4’ 

i  .  ie 

(  tr (<■ 1 

(3.2) 

tr  e1  1  •’ 

i :  ,t/<  •  /<' 
i 

1  •  •  '  tr  (c: 

(33) 

tr  e\-"-. 

(  trie-' 

*  e:,,l 

By  randomly  generating  A  and  B.  (3.1 )  was  shown  to  be  false  Since  (3.2)  implies  (3.1). 
(3  2)  must  also  be  false  Furthermore,  in  the  case  H'  -  -B.  inequality  (3.1).  which 
becomes 


(3.4) 


tr  r 


n  I  ,  , 

2  +  ?  tr  *• V 


was  also  shown  to  be  false  Hence  (2.4)  and  (2.5)  cannot  be  merged.  Finally,  the  remaining 
inequality  (3.3)  was  also  shown  to  be  false  even  when  B  =  0. 

Remark  The  results  of  this  paper  can  be  generalized  to  the  case  in  which  A  and  B 
are  complex  matrices.  Generalization  to  arbitrary  spectral  functions  [5]  remains  an  area 
for  further  research. 
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PROBLEMS 

Commuting  Matrix  Exponentials 

Problem  88-1*,  by  Dennis  S.  Bernstein  (Harris  Corporation,  Melbourne,  Florida). 

In  feedback  control  theory  for  sampled-data  systems,  the  equivalent  discrete-time 
dynamics  matrix  is  given  by  eAH,  where  h  is  the  sample  interval  and  A  is  the  dynamics 
matrix  for  the  original  continuous-time  system.  When  A  is  perturbed  by  A0  (due 
possibly  to  some  modeling  uncertainty),  then  it  is  necessary  to  consider  elA*A‘,v'.  For 
robust  control  system  design  it  thus  may  be  of  interest  to  know  when  e{4+A°)h  can  be 
decomposed  into  a  nominal  part  involving  A  and  a  perturbed  part  involving  Au. 
Analogous  questions  arise  in  the  study  of  bilinear  control  systems  of  the  form 

x = ,4.v  +  uBx. 

where  u  is  a  scalar  control.  In  this  case  the  Lie  group  generated  by  A  and  B  plays  a 
central  role.  Again,  it  is  of  interest  to  know  how  c  '*w  is  related  to  e4  and  e".  the 
principal  result  being  the  Baker-Campbell-Hausdorff  formula.  Of  course,  it  is  well 
known  that  when 

(1)  AB  =  B.4, 
where  A,  B  are  real  n  x  n  matrices,  then  both 

(2)  rV*=fV 

and 

(3)  r '<•"=<• ,+" 

hold.  It  is  less  well  known  that  the  converse  is  not  true.  Specifically,  examples  are 
given  in  (1]  which  show  that  (2)  may  hold  while  (1)  and  (3)  are  violated,  and  that  (3) 
may  hold  while  (1)  is  violated.  Interestingly,  it  is  stated  without  proof  in  [I]  that 
(3)  implies  (2).  Prove  this  claim  or  find  a  counterexample.  A  copy  of  [1]  is  available 
from  the  proposer. 
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ABSTRACT 

In  this  paper  ve  consider  the  robust  stability  of  a  continuous-time 
system  under  computer  control.  The  uncertainty  is  modeled  as  additive  per¬ 
turbations  to  the  matrices  in  a  continuous-time  state  space  description  of 
the  plant.  Our  methods  exploit  the  resulting  exponential-like  uncertainty 
structure  in  the  sampled-data  control  system  and  we  develop  sufficient 
conditions  for  such  a  system  to  be  robustly  stable. 


1.  Introduction 


A  sampled-data  control  system  consists  of  a  continuous-time  plant  under 
computer  control;  see  Figure  1.  Generally  speaking,  if  the  matrices  in  a 
state  space  description  of  a  continuous-time  plant  are  uncertain,  then  the 
resulting  closed-loop,  discrete-time  system  possesses  an  exponential-like 
uncertainty  structure.  This  is  true  even  if  the  continuous-time  plant  has 
linear  uncertainty.  Existing  methods;  e.g. ,  see  [1]— [4] ,  are  inadequate  in 
analyzing  such  uncertain  discrete-time  systems  since  they  do  not  directly 
handle  these  exponential-like  structures.  Notable  exceptions  include  the 
conic  sector  approach  in  15],  and  the  stochastic  parameter  formulation  in 
[6].  Indeed,  the  present  paper  was  motivated  by  the  approach  of  [6]  which, 
as  shown  in  [12]  can  be  reinterpreted  to  yield  conditions  for  deterministic 
robust  stability.  Our  objective  is  thus  to  develop  a  robust  stability  test 
which  exploits  the  specific  nonlinear  uncertainty  structures  occurring  in 
sampled-data  control  systems. 

In  the  sequel,  the  following  notation  will  be  used.  For  X  e  Rnxn,  X' 
denotes  the  transpose  of  X,  while  X  >  0  (X  >  0)  means  that  X  is  positive 
definite  (positive  semi-definite).  The  spectral  radius  of  X  is  given  by 
p(X).  Le t  (x) , (+) and  "vec"  denote  the  Kronecker  product,  Kronecker  sum  and 
column  stacking  operators  respectively;  see  [9].  In  addition  we  shall  use 
"vec  to  denote  the  operation  of  forming  a  (usually  square)  matrix  from  a 
column  vector. 

2.  Problem  Formulation 

In  this  section  we  state  the  robust  analysis  problem  for  sampled-data. 
control  systems  using  static  feedback.  To  begin,  consider  the  n-dimensional 
continuous-time  plant 


x(t)  =  (A  +  AA)x(t)  +  (B  +  AB)u(t) 
y(t)  =  Cx(t) 

(S) 

where  A  e  Rnxn,  B  e  Rnxm  and  C  e  R^*11  denote  nominal  state  space  data  and 
where  M  and  AB  represent  perturbations  in  A  and  B  respectively.  The  pair 


2 


of  suitably  dimensioned  matrices  (AA,  AB)  belongs  to  an  uncertainty  set  U 
given  by 


P  P 

U  =  {(M,  AB):  AA  =  £  a. A.  and  AB  =  £  a.  B., 

i=l  1  1  i=l  1  1 


P  2 

£  a.  <  1} 

,  i  - 


where  A.  and  B.  reflect  the  "structure”  of  the  uncertainty  and  where  a.  is 
ii  J  l 

an  uncertain  real  parameter;  note  that  an  uncertain  parameter  cr^  may  appear 
in  both  AA  and  AB,  and  it's  possible  to  have  A.,=  0  and  t  0  or  vice-versa. 

Now,  consider  the  sampled-data  system  in  Figure  1  with  a  sampling 
period  of  h  seconds.  We  assume  perfect  synchronization  between  the  A/D 
(sampler)  and  the  (D/A)  (zero-order  hold)  and  ignore  finite  word-length 
effects  and  computational  delays.  We  also  assume  that  a  static  control  law 


u(kh)  =  Ky(kh) ;  k  =  0,1,2,..., 


(2.2) 

is  implemented  for  some  given  gain  K  e  Rmx\ 

Our  purpose  is  to  analyze  the  robust  stability  of  this  closed-loop 
system,  and  to  this  end  we  consider  its  evolution  at  the  sample  instances  kh 
by  forming  the  associated  discrete-time  system 


x(k+l)  =  [e 


(A  +  AA)h 


Jo 


(A  +  AA)x 


dt(B  +  AB)KC]x(k). 


(2.3) 


In  the  above  x(k)  denotes  x(kh);  we  have  abused  notation  for  the  sake  of 
conciseness.  Given  arbitrary  (AA,  AB)  t  U,  system  (2.3)  is  discrete-timd~ 
stable  if  all  the  eigenvalues  of 


g(A  +  AA)h  +  r  e(A  +  AA)TdT(g  + 

J0 

lie  within  the  open  unit  disk.  Additionally,  (2.3)  is  said  to  be  robustly 
discrete-time  stable  if  it  is  discrete-time  stable  for  all  (AA,  AB)  e  U. 


■ 


3.  Main  Result 
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We  now  develop  a  sufficient  condition  for  the  robust  stability  of 
(2.3).  This  condition  exploits  the  exponential  structure  of  the  uncer¬ 
tainty;  i.e.,  rather  than  "overbounding"  the  uncertainty  with  an  additive 
model  of  the  form 


x(k+l)  =  (*  +  A*)x(k), 

our  methods  treat  the  exponential  structure  of  the  nonlinearity  in  (2.3) 
more  directly. 

To  show  robust  stability  we  will  construct  a  parameter-independent 
(independent  of  the  uncertain  matrices  (M,  AB))  quadratic  Lyapunov  function 
V(x)  for  (2.3).  Thus,  let  P  be  some  free,  positive-definite  symmetric 
matrix  and  consider  the  quadratic  Lyapunov  candidate 

V(x)  «  x'Px,  x  e  Rn. 

System  (2.3)  is  robustly  discrete-time  stable  if 

AV(AA,  AB,  P)  = 

Ie(A+AA)h  +  P  e(A+AA)-cdT(B+AB)KC j'  P  [e(A+M>h  +  e(A+M)TdT(B+AB)KC]  -  P 
J0  J0 

(3.1) 

is  negative  definite  for  all  (AA,  AB)  z  U.  This  follows  since  x'AVx  is  the 
Lyapunov  difference  associated  with  V=x'Px  and  (2.3);  i.e., 

x ' AV ( AA ,  AB,  P)x  =  V(x(k+1) )  -  V(x(k)). 

System  (2.3)  is  robustly  discrete-time  stable  if  this  difference  is  negative 
for  all  x  c  Rn  and  all  (AA,  AB)  e  U;  e.g.,  see  [7]. 

A  critical  step  in  our  development  is  to  express  the  uncertainty  in 
(3.1)  solely  in  terms  of  the  matrix  exponential.  Indeed,  using  the  identity 
(see  (8]) 
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T(A  +  AA)  (B  +  AB)lh)  =  p 

L  0  0  J  L 


(A+AA)h  r  e(A+AA),  dT(B+AB)- 


(3.2) 


(3.1)  can  be  rewritten 


A V(AA,  AB,  P)  = 


II  0]exp([<A+M)  <B+AB)lh)fI  ]P[I  C'KMexp(r(A+M>  (B+AB>1 'h)  T  1  1  -  P 

.o  oJLkcj  o  oJLo. 

(3.3) 

Our  next  result  provides  a  parameter-independent  upper  bound  to  AV.  To  give 
this  bound,  let  a  >  o  be  given  and  define 

-  A  .  [A  B1  a  .  ^  .  [A  B1  a  T.  1  ?  Ai  B i  1  /, — .  fA i  Bi 

lo  OJ  *  2  r)  © ( lo  oj  *  2  r>  *  S  0J®[0  0 


(3.4) 


-  [  KC  ]  P  t1  C'K'>. 


(3.5) 

positive  definite 


Lemma  3 . 1  (See  Appendix  for  proof):  If  P  e  Rn  is 
and  symmetric  and  a  >  0,  then 

AV( AA,  AB,  P)  = 


II  0|p*p([</UM)  1 P 1 1  C’K-|«*P(  <B+aB>l'h>r  1  1  -  f 

lo  oJIkcJ  lo  ojloj 


1  A  h  P  _  _ 

<  II  oj  vec"  [e  a  vec(np)J  Q  J  - 


(3.6) 


for  all  (AA,  AB)  z  U. 


Now,  using  the  right-hand  side  of  (3.6),  formally  set 
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[I  0]  vec  *{e  a  vec( np) ]  [  g  ]  -  P  =  -I 
which  is  equivalent  to 


(3.7) 


where 


(Ma  -  I)vec(P)  =  -vec(I) 


(3.8) 


I1  °l'A“h< Uc  ]®[kc  ]>. 

(3.9) 

When  does  (3-8)  have  a  positive-definite  solution?  Our  next  lemma  gives  a 
sufficient  condition. 


Lemma  3-2  (See  Appendix  for  proof):  If  there  exists  an  a  >  0  such  that 


p(Ma)  <  1, 

then  (3.8)  has  a  positive-definite  solution  P. 


(3.10) 


Now,  assume  (3.10)  holds  for  some  a  >  0.  From  Lemma  3.2,  equation 
(3.7)  has  a  positive-definite  solution  P;  hence,  using  (3.6)  and  (3.7)  it 
follows  that 


for  all  (AA,  AB)  s  U. 


AV( AA,  AB,  P)  <  -I 


(3.11) 


We  have  thus  proven  the  following  main  result. 


Theorem  3.1:  If  there  exists  an  a  >  0  such  that 


p(Mb)  <  1, 

then  the  sampled-data  system  (2.3)  ^s  robustly  discrete-time  stable. 
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It's  important  to  note  that  the  condition  of  Theorem  3.1,  pCM^)  <  1,  is 
always  satisfied  if  the  "nominal"  system  is  stable  and  there  is  no  uncer¬ 
tainty;  i.e.,  AA  =0  and  AB  =  0.  Indeed,  taking  a  =  0,  a  straightforward 
manipulation  using  (3.2),  (3.4),  (3.9)  and  identities  (A.l)  -  (A. 4)  in  the 
Appendix  gives 

M  =  (eAh  +  f*  eATBKCdT)  ®  (eAh  +  f*  eATBKCdt). 

«  Jq  Jq 

(3.12) 


Since  the  nominal  system  is  stable,  then  all  the  eigenvalues  of 

Ah  f1  At 
e  +  e  BKCdx 

J0 

lie  within  the  unit  disk'.  This  implies,  together  with  (3.12)  and  the  fact 

that  the  eigenvalues  of  a  Kronecker  product  of  two  matrices  are  the  products 

of  the  eigenvalues  of  these  two  matrices  (see  [9]),  that  all  the  eigenvalues 

of  M  lie  within  the  unit  disk.  Thus,  p(M  )  <  1. 
a  a 

The  stability  result  of  Theorem  3.1  is  also  valid  for  the  case  when 
(2.3)  has  time-varying  uncertain  parameters  cr^(t).  This  is  a  consequence  of 
having  established  stability  via  a  parameter-independent  Lyapunov  function. 
Finally,  we  remark  that  a  dual  result  holds  when  AB  =0  and  one  allows  uncer¬ 
tainty  in  C;  i.e,  C  -*  C  +  AC. 

4 .  Example 

In  Soroka  and  Shaked  [13J,  the  robustness  of  a  continuous-time  system 
under  "cheap"  LQ  regulation  is  studied.  The  resulting  closed-loop  system  is 
described  by 


x(t)  =  [A  +  (B  +  AB)Lj_]x(  t) 
y(t)  =  Cx( t) 

(4-1) 


where 
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A  = 


AA  =  0; 


a  >  0 


and  where  the  LQ  regulator  gains  are  given  by 


(A. 2) 


L  =  [1  +  q  -  /5  +  2q  2/5+2q  -  q  -  4]';  q=/4+l/r 

(4.3) 

with  r  >  0  being  the  control  weighting  in  the  quadratic  performance  index 

[y2(t)  +  ru2(t))dt. 

Soroka  and  Shaked  shoved  that  stability  robustness  decreased  as  the  control 
became  more  cheap  (r  -»  0). 

Now,  suppose  this  LQ  regulator  gain  is  to  be  implemented  in  a  computer. 
What  is  the  robustness  of  this  sampled-data  control  system?  We  shall  use 
the  sufficient  condition  in  Theorem  3.1  to  help  answer  this  question. 
First,  however,  we  translate  the  continuous-time  LQ  gain  to  one  suitable  for 
sampled-data  control  since  the  nominal  discrete-time  system  is  unstable  if 
we  implement  gain  K.  =  L  in  the  computer.  Following  [pp.  189-191,  Astrom 
and  WittenmarkJ,  we  take 


£ 


K  =  L  [I  +  (A  -  BL  )h/2]. 


(4.4) 


For  given  sampling  period  h,  control  weighting  r  and  uncertainty  bound  a,  we 

are  now  in  a  position  to  determine  if  p(M  )  <  1  for  some  a  >  0.  For  ex- 

a 

ample,  for  h  =.l,  r  =  .05  and  a  =  .5,  we  plot  p(M  )  versus  a  in  Figure  2  and 

(X 

observe  that  p(M  )  <  1  for  a  >  .3.  Hence,  the  sampled-data  system  is  stable 

oc 

for  a  =  .5.  Also,  for  h  =  . 1  we  determine,  for  various  r,  the  largest  a  for 
which  p(M  )  <  1  for  some  a  >  0.  Ve  compare  these  results  to  the  actual 
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discrete-time  stability  boundary  and  to  Soroka  and  Shaked's  results  [13]; 
see  Figure  3.  To  compute  the  the  actual  discrete-time  stability  boundary, 
we  assume  time-invariant  uncertainty  cr^  and  find  the  largest  a  for  which 

,  Ah  j^1  Ax ,  f  1  +  a,  . 

p(e  +  e  dx  .  I  K)  <  1. 

J0  L  J 

(A. 5) 

for  all  | |  <  a.  Recall  that  the  stability  result  in  Theorem  3.1  is  valid 
for  time-varying  uncertainties  a^(t)  as  well;  hence,  it's  natural  to  expect 
that  the  resuts  using  p(M^)  viH  be  conservative  compared  to  those  using 
(4.5).  This  was  indeed  true  except  for  values  1/r  =  10.  For  these  values, 
the  stability  criterion  of  Theorem  3.1  predicts  ranges  of  stable  which 
are  larger  than  those  computed  using  (4.5).  This  is  clearly  incorrect  and 
we  contribute  these  discrepencies  to  roundoff  errors  in  the  computations. 
Finally,  we  note  that  the  actual  discrete-time  stability  region  is  larger 
than  its  continuous-time  counterpart. 
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APPENDIX:  PROOF  OF  LEMMAS  3.1  AND  3.2 

To  prove  Lemmas  3.1  and  3.2  we  first  need  some  identities  and  observa¬ 
tions;  see  (0]  for  details. 

1TX1T  s  XS 

Iden t i ties :  If  X  £  R  and  Y  e  R  ,  then  by  definition  the  Kronecker 
sum  is  given  by 


X©Y  X0I  +  I0Y. 

Next,  if  the  indicated  products  exist,  then 

vec(XYZ)  -  (Z'  @X)vec(Y) 
<X0Y)<Z0W)  =  (XZ)  0(YV>. 
Finally,  if  X  is  square,  then 


(A.l) 


(A. 2) 
(A. 3) 


Observation  1:  Given  arbitrary  (AA,  AB) 

matrix  differential  equation 


(A. 4) 

e  U,  the  solution  to  the 


(A+AA)  (B+AB) 
0  0 


is 


t  >  0,  Y(0)  =  Yq 

(A. 5)  - 


Y(t) 


(A+AA)  (B+AB) 
0  0 


l0 


(A+AA)  (B+AB) 
0  0 


(A. 6) 

This  is  a  well-known  result. 

Observation  2:  Let  a  >  0,  then  the  solution  to  the  matrix  differential 
equation 
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[t  5]  ♦  2  1)7<t>  * 

BV  a  Ts  1  ? 

OJ  +  2  :)  +  a  z 

rA .  b  .  i 
1  1 

Y(t) 

[A.  B . 
l  l 

uj  ^  a.=1 

.0  0. 

.0  0. 

t  >  0,  Y(0)  =  Y, 


(A. 7) 


is 


At  _ 

Y(t)  =  vec  [e  a  vecCY^)]. 

(A. 8) 

To  show  (A. 8),  apply  the  "vec"  operation  to  both  sides  of  (A. 7)  and  use 
identities  (A.l)  and  (A. 2)  to  get 


vec(Y(t))= 

«[o  o]*?I>©<[$  o]  -  I  x> 

The  solution  to  (A. 9)  is 


P 

E  ( 

[A- 

X 

B .  1 

l 

® 

[A. 

1 

B . 

1 

i=l 

.0 

0. 

0 

0. 

)) vec(Y( t) ) 

(A. 9) 


_  At 

vec(Y(t))  =  [e  a  vec(YQ)] 


from  which  (A. 8)  follows. 

Observation  3:  If  a  >  0  and  if  Yq  is  positive  semi-definite,  then  the- 
solution  in  (A. 8)  satisfies 


To  prove  this 
From  (A. 2) 


i  At 

Y(t)  =  vec-  [e  a  vec(YQ)]  >0,  t  >  0. 

(A. 9) 

observation,  let  S,N  s  R  with  N  positive  semi-definite. 


(S  (x)S)vec(N)  =  vec(SNS') 
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which  implies 


-1 


vec  [  (S  @S)vec(N)  ]  =  SNS'  >  0. 


Using  (A. 3) 


(S  (?)  S) 1  =  (S'QS1) 


so  that 


00 

vec  ^[e^ ® ^vec(N) ]  =  vec~*[  E  (i ! )-*(S (x)S)*vec(N) ] 


i=0 


=  vec_1[  Z  ( i ! )—1 (S1  (x)S1)vec(N) ] 
i®0 


QO 

=  Z  vec_1l(i!)~1(S1  @S1)vec(N)] 
i=0 


—  1  i  i  f 
=  Z  (i!)  S  NS 


i=0 


>  0. 


Furthermore,  from  (A. 4)  and  (A. 10) 

*[eS©  ^vec(N)  ]  =  vec-* [  (e^  (x)e^)vec(N)  I 


vec 


C  C  / 

=  e  Ne" 


>  0. 


(A. 10) 


(A. 11) 


(A. 12) 


(A. 13) 


Now,  using  the  exponential  product  formula  (see  110,  pg.  97])  we  write 


12 


where 


Consequently, 


(A. 14) 


(A. 15) 


-1  V 

vec  [e  vec(Yg) ] 

=  vec-1  j"lim  {exp[^(Aa0  40 1 J  II  exp[i  .  (A.  0  A.  )  t  ] ) j  vec(Y0)| 
vec_1|^{exp[j(Aa0Aa)t J  n  exp[^(A.  @A.) t ] } j vec(YQ)J  • 

(A. 16) 

We'll  now  show  that  the  expression  in  the  limit  brackets  in  (A. 16)  is  posi¬ 
tive  semi-definite  for  all  positive  integers  j.  Indeed,  this  is  sufficient 
to  prove  that  (A. 9)  holds.  For  simplicity  take  j  =  p  =  1  and  let  N  satisfy 


=  lim 

-j-KD 


vec(N)  =exp[i(Ai  0Ai)t]vec(YQ) 

or  equivalently 


(A. 17) 


N  =  vec_1{exp{i(A.  0A.  )t]vec(YQ)} 


(A. 18) 

Since  Yq  is  assumed  positive  semi-definite,  then,  from  (A. 12),  N  is  positive 
semi-definite.  From  (A. 13),  (A. 17)  and  this  fact,  the  expression  in  the 
limit  brackets  of  (A. 16)  satisfies 


exp[(Aa@Aa)tJexp[i(A.  @A.  )tJvec(Y0)  =  exp[  (A^Q  A^)  t  ]vec(N) 


>  0. 

A  similar  argument,  using  (A. 12)  and  (A. 13)  alternately,  shows  that  the 
expression  in  the  limit  brackets  of  (A. 16)  is  positive  semi-definite  for 
arbitrary  positive  integers  j  and  p.  This  completes  the  proof  of 
Observation  3. 


Proof  of  Lemma  3.1:  Assume  P  positive  definite  and  a  >  0.  Furthermore, 
consider  the  matrix  differential  equations  in  (A. 5)  and  (A. 7)  with 


(A. 19) 

where  IIp  is  given  in  (3.5).  Subtracting  (A. 5)  and  (A. 7)  gives 

Y(t)-Y(t)  =  [(AJM)  (B+QB)](Y(t)-Y(t))  +  <Y(t)-Y(t))[(AJM)  (B+£B>]'  +  yt) 

t  >  0,  Y(0)-Y(0)  =  0 

(A. 20) 


where 


A  -  -  -  -  1  P  -  -  - 

▼  (t)  =  A  Y(t)  +  Y(t)A'  +  i  l  A  Y(t)A! 
a  a  a  a.  ,  x  l  - 

1  =  1 

-  < [<A;M)  .  Y<t>  [<*;“>  (%“)]', 

(A. 21) 

and  where  A  and  A.  are  defined  in  (A. 15). 
a  l 

Claim  1:  Y  (t)  is  positive  semi-definite  for  all  t  >  0. 

-  a  - 

Proof  of  Claim  1:  From  (A. 15)  and  (A. 21) 
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V°  ‘  ([o  o]  *  2  lh  5  *> 


([<*j“>  ,  f(t) [<*;“>  <%“)]') 


=  E  A. Y(t)A; 
a.  ,  l  l 

1  =  1 


■  «Y(t) 


+ 


A. Y( t )A: 
11 


p?_  p  _  _  1  p 

>  a  E  <tTY  ( t )  -  E  a.  (A.  Y(  t)  +  Y(t)A!)  +  -  E  A.Y(t)AC 

-  .-1  ..11  l  a.  ,11 

1=1  1=1  1=1 


P  1  ~  —  1 

=  E  [/acr. I  -  -  A.  ]  Y(  t)  [  /aa.  I  -  -  A.  ] '  . 

i=i  1  r*  1  1  1 


From  Observation  3,  Y(t)  is  positive  semi-definite  for  all  t  >  0. 
follows  from  (A. 22)  that  T^t)  is  likewise  positive  semi-definite 
t  >  0.  This  proves  the  claim. 

Now,  since  Y(0)  -  Y(0)  =  0,  the  solution  to  (A. 20)  is 


(A. 22) 
It  thus 
for  all 


Y(t)-Y(t)  =  J^exp[[(AJM)  (B^>](t-s),  Ya(s)  exp[[(AJM)  (B+JB)] '  ( t-s)  J  ds. 

(A. 23) 

From  (A. 23)  and  Claim  1  it  follows  that 


Y(t)  -  Y(t)  >0,  t  >  0. 

(A. 24) 

Combining  (A. 6)  and  (A. 8)  with  (A. 24)  gives 
0  <  Y(h)  -  Y(h) 

-lr  Aah  /n  ..  ,  r(A+M)  (B+AB)].  .  _  ,  f(A+M)  (B+AB)1 ' 

=  vec  [e  vec(np)I  -  exp(  0  0  Jh)  np  exp(  ^  Q  0  J  h) 

which  implies  that 

[I  0,exp(  [<**“>  <»‘“>]h)  h  exp([<S;“»  <»*“>]'h)[  J  ]  -  P 
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A  h 


<  (I  OJvec  1[e  a  vec( np) ]  [  *  -  P 


which  is  the  desired  result.  The  proof  of  Lemma  3.1  is  complete. 


VW 


Proof  of  Lemma  3.2:  Assume  a  >  0  such  that  (3.10)  holds.  We  must  show 

that  (3-8)  has  a  positive-definite  solution  P.  Indeed,  since  p(M  )  <  1, 

a 

then  (M  -  I)  is  invertible  and  (3.8)  has  a  unique  solution 

(X 

-1 


or 


vec(P)  =  (I  -  M  )  vec(I) 

CL 


P  =  vec  *[(I  -  Ma)~^vec(I) ] . 

Now,  with  M°  =  I,  it  follows  from  [11,  Theorem  6.7.1]  that  (I  -  M  )-1 

_  <*  a 

i 

E  M  .  Consequently, 
i=0  a 

CO  CO 

P  =  vec  [  E  M^vec(I)]  =  E  vec~^[M*vec(I) ] . 
i=0  a  i=0  a 


(A. 25) 


Claim  2:  If  i  is  a  positive  integer,  then 


vec  ^[M*vec(I)]  >  0. 
a  — 

(A. 26) 

Proof  of  Claim  2:  The  proof  proceeds  by  induction.  From  the  defini¬ 
tion  of  in  (3.9)  and  identity  (A. 2),  we  have  for  i  =  1 


A  h 


vec  1[Mavec(I)]  =  vec-1{[I  0]e  a  ( [  Jc  ]  ©  [  gC  ]>vec<1>} 


i  A  h  r  t  i 

vec-  {[I  OJe  a  vecq  RC  J  [I  C'K'  ])} 


<  Ah  p  _  .  p  _ 

[I  0]vec  {e  a  vec( [  ^  J[I  C'K'))}[J]> 


(A. 27) 
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It  follows  from  (A. 9),  (A. 27)  and  Observation  3  with 

Y(0)  =  [  £c  ][I  C'K'],  t  =  h 

that  vec_1[M  vec(I)]  >  0.  Nov,  for  the  induction  step, 

vec  [M1vec(I)]  >  0.  Then 
a  — 

vec-^  [M*+^vec(I)  ]  =  vec  ^[M  M^vec(i)] 
a  a  a 

=  vec -^{M  vec[vec  ^(M^vec(I) ) J } . 
a  <x 


From  (A. 28)  and  Observation  3  with 

7(0)  =  vec_1[MVec(I)J,  t  =  h, 

it  follows  that  vec_1[M1+1vec(I) ]  >  0.  This  proves  the  lemma. 

a  — 


assume 


(A. 28) 


7W 
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Figure  3  :  Comparison  of  several  methods  for 
determining  the  stability  boundary 


